Some systems are experiencing issues

About This Site

Maintenances and incidents regarding our services, networks and datacenters can be followed here.

Scheduled Maintenance
[DC5] Scheduled maintenance Room 1 - Racks A19, A20, A22, A23, A24

A scheduled maintenance is planned in DC5 (Room 1 - A19, A20, A22, A23, A24) in order to optimize and upgrade our infrastructure.

It will be done gradually on the racks, in the same order as in the object of the maintenance.

As a result servers will lose their public network connectivity as our switches are being upgraded, but private network connectivity will still be functional. It will come back gradually following the scheduled upgrades. We estimate the downtime to be between 10 and 20 minutes.

Updates will be posted below as the maintenance is going on.

Start : September 23th, 2020 - 05:00 UTC

Duration : 2 hours

[DC3] Maintenance on power contactor

We will carry out curative maintenance on GF1, GF3, and GF5: Replacement of contactors on A and B circuit.

  • Thursday 24/09: Chiller n°1 substation A
  • Friday 25/09: Chiller n°3 substation A
  • Monday 12/10: Chiller n°5 substation B

Impact: None expected

Start: 24-Sep-2020 0700Z (0900LT)
End: 12-Oct-2020 1400Z (1600LT)
[ROUTER] Core router maintenance - Preparation

Location : Paris - Core router bb1.dc3

What is done : Upgrade hardware and reload bb1.dc3 to enable new 100G ports.

Impact : None expected, traffic will be rerouted elsewhere.

Preparation - duration 2h

  • Start time : 29-Sept-2020 0300 UTC (0500 UTC+2)

  • End time : 29-Sept-2020 0500 UTC (0700 UTC+2)

[ROUTER] Core router maintenance - Upgrade

Location : Paris - Core router bb1.dc3

What is done : Upgrade hardware and reload bb1.dc3 to enable new 100G ports.

Impact : None expected, traffic will be rerouted elsewhere.

Upgrade - duration 4h

  • Start time : 30-Sept-2020 0200 UTC (0400 UTC+2)

  • End time : 30-Sept-2020 0600 UTC (0800 UTC+2)

[DC3] Annual maintenance of UPS

Annual maintenance of UPS in DC3

We will perform the annual maintenance of the inverters of electrical chains A, B, C and D. The inverters of these electrical chains supply racks of IT halls.

Operations will be performed by our maintainer under our permanent supervision, according to the following previsional schedule :

 Day                   Impacted electrical chain
 Monday 05 October     Electrical chain A
 Tuesday 06 October    Electrical chain B
 Wednesday 07 October  Electrical chain C
 Thursday 08 October   Electrical chain D
 Friday 09 October     Reserved if planning delayed

This maintenance requires isolating each UPS in order to intervene on the device. The downtime of an UPS is estimated to take 30 minutes.

The operation will be done UPS by UPS and will have no impact on your equipments housed in our Datacenter : the others UPS of the electrical chain are sized to recover the load from the offline UPS.

Impact : None

Start : 5-Oct-2020 0630Z (0830LT)
End: 9-Oct-2020 1530Z (1730LT)

Duration : 5 Days

[ROUTER] Core router maintenance - Preparation

Location : Paris - Core router bb2.dc3

What is done : Upgrade hardware and reload bb2.dc3 to enable new 100G ports.

Impact : None expected, traffic will be rerouted elsewhere.

Preparation - duration 2h

  • Start time : 14-Oct-2020 0300 UTC (0500 UTC+2)

  • End time : 14-Oct-2020 0500 UTC (0700 UTC+2)

[ROUTER] Core router maintenance - Upgrade

Location : Paris - Core router bb2.dc3

What is done : Upgrade hardware and reload bb2.dc3 to enable new 100G ports.

Impact : None expected, traffic will be rerouted elsewhere.

Upgrade - duration 4h

  • Start time : 15-Oct-2020 0200 UTC (0400 UTC+2)

  • End time : 15-Oct-2020 0600 UTC (0800 UTC+2)

Past Incidents

Monday 21st September 2020

[DC5] Emergency maintenance - Part of rack D27 - Public network, scheduled 22 hours from now

Maintenance is cancelled, already done as of 2020-09-19

We have detected a faulty hardware and a replacement will be needed. As we proceed with the replacement, a part of D27 will be unavailable on the public network.

Block G : Unavailability up to 30 minutes.

Block H, I, J : There will be several short disruptions, with a cumulative maximum of 5 minutes.

Operation window : 30 minutes

Start : September 21th, 2020 - 0900 UTC (1100 UTC+2)

End : September 21th, 2020 - 0930 UTC (1130 UTC+2)

[DC5] Emergency maintenance - Part of rack D22 - Public network, scheduled 22 hours from now

Maintenance is cancelled, already done as of 2020-09-19

We have detected a faulty hardware and a replacement will be needed. As we proceed with the replacement, a part of D22 will be unavailable on the public network.

Block B : Unavailability up to 30 minutes.

Block C, D, E : There will be several short disruptions, with a cumulative maximum of 5 minutes.

Operation window : 30 minutes

Start : September 21th, 2020 - 0830 UTC (1030 UTC+2)

End : September 21th, 2020 - 0900 UTC (1100 UTC+2)

Sunday 20th September 2020

[Scaleway Elements] Registry api rdb kubernetes

We identified an issue with our container registry.

API and push/pull operations are affected.

Kapsule and RDB are also affected by this issue leading to the creation being stuck.

===================

20/09/20 0849Z (1049LT)

Issue has been fixed. If problems remain, please contact our support team.

20/09/20 0702Z (0902LT)

Issue has been escalated to local team

Saturday 19th September 2020

DC5 Network [DC5] Switches unavailable in racks D22, D27, D57

A few switches related to racks D22, D27, D57 are currently unavailable.

They are unavailable due to an electrical issue that is impacting them.

This incident is now resolved, please get in touch with our technical assistance if you still experience any issue!

===================

2020-09-19 1719Z (1919LT)

Rack D27 is back up as well, all fixed

2020-09-19 1651Z (1851LT)

Rack D22 is also back up, still checking D27

2020-09-19 1609Z (1809LT)

Rack D57 is back up, still checking D22 and D27

2020-09-19 1513Z (1713LT)

Our on-call team is checking the racks

2020-09-19 1328Z (1528LT)

Issue has been escalated to local team

RPN services [RPN] RPN V1 unusable

We are experiencing issues on RPN V1 at the moment.

A flap occured on the core routers of RPNv1, we are resetting manually some interconnections which are stuck in a transient state to restore communication with all routers.

Our team is mobilized to resolve the issue as quickly as possible.

===================

09.19.2020 0939Z (1139LT)

Issue has been fixed. If problems remain, please contact our support team.

09.19.2020 0915Z (1115LT)

Issue still present on numerous RPN, we are still investigating.

09.19.2020 0845Z (1045LT)

Issue seems to be partially resolved, we invite you to contact the support if the issue persists.

09.19.2020 0820Z (1020LT)

Issue has been escalated to local team

Friday 18th September 2020

DC3 [DC3] - Rack Bay Down (E2 - R 4-4-4)

We are experiencing an unavailability of service in the following rack : [DC3] Room: 4 4-4, Rack: E2 Our team is mobilized te resolve the issue as quickly as possible.

===================

18/09/20 0945Z (1145LT)

The issue has been identified and fixed. We apologize for any inconvenience this may cause.

18/09/20 0435Z (0635LT)

We have identified an issue

Thursday 17th September 2020

No incidents reported

Wednesday 16th September 2020

No incidents reported

Tuesday 15th September 2020

No incidents reported

Monday 14th September 2020

No incidents reported