Some systems are experiencing issues

About This Site

Maintenances and incidents regarding our services, networks and datacenters can be followed here.

Scheduled Maintenance
[MAINTENANCE DC5-A] Racks E1;E2;E3;E4;E5;E6

A scheduled maintenance is planned in DC5-A with a physical displacement of your servers listed above in order to optimize and upgrade our infrastructure. Servers will be unavailable for the duration of the maintenance detailed below.

This status will be updated as the operations are going through to keep you informed about the events.

Start : June 8th, 2020 - 2000UTC (2200LT)

End : June 9th, 2020 - 0300UTC (0500LT)

[MAINTENANCE DC5-A] Racks B1;B2;B5;B6;B14;C9;C10;C13;C14;C15;C16;C17;C18;C19

A scheduled maintenance is planned in DC5-A with a physical displacement of your servers listed above in order to optimize and upgrade our infrastructure. Servers will be unavailable for the duration of the maintenance detailed below.

This status will be updated as the operations are going through to keep you informed about the events.

Start : June 15th, 2020 - 2000UTC (2200LT)

End : June 16th, 2020 - 0300UTC (0500LT)

[DC3] Preventive electrical maintenance of generators

[DC3] Preventive electrical maintenance of generators

We’re going to carry out the preventive electrical maintenance of generators.

The maintenance will be performed electrical chain by electrical chain, so that super-rescue generators (chain F1) can recover the load, in the event of an electrical incident coming from the usual network of energy supply.
Maintenance will be carried out according to the following forecast schedule:

  • Chaine A : 22/06
  • Chaine B : 23/06
  • Chaine C : 24/06
  • Chaine D : 25/06
  • Chaine F1 : 29/06
  • Chaine F2 : 30/06

Every evening, generators on which maintenance has been done will be put back into service.
No generator will remain out of service in absence of the maintenance company

Impact : Degradation of electrical redundancy

Start : 22-Jun-2020 0630Z (0830LT)
End : 30-Jun-2020 1530Z (1730LT)
[DC3] Maintenance of fire suppression systems

Maintenance of fire suppression systems

Control VESDA system

Control manual triggers

Control sound and visual alarms

Control Actuated Devices of Safety

Control alarm reports

Control fire suppression valves (outside datarooms)

Control smoke extraction and extraction engine

Impact : none

Schedule : 22-23-Jun 2020 0730-1600Z 0930-1800LT
30-Jun-3-Jul 2020 0730-1600Z 0930-1800LT
13-17-Jul 2020 0730-1600Z 0930-1800LT
[DC3] Semi-annual maintenance of distribution pumps

[DC3] Semi-annual maintenance of distribution pumps

We will perform the semi-annual maintenance of the distribution pumps. Operations will be performed by our maintainer under our permanent supervision, according to the following previsional schedule:

 Wednesday June 24th Sub-stationA
 Thursday June 25th Sub-stationB
 Friday June 26th Sub-stationC

Substations A and B supply the chilled water network of the computer halls. Substation C supplies the chilled water network of the operators halls and the air handing units.

Impact : no impact for customers

Start : 24-Jun-2020 0700Z 0900LT

Duration : 13 Days

[DC3] Pressurization maintenance

[DC3] Pressurization maintenance

What is done : We will perform a pressurization maintenance on substation SSA, SSB and SSC.

Sub station C, June 26th

Sub station A &B, June 29th

Impact : None

Start : 26-Jun-2020 0730Z 0930LT

Duration : 2 Days

Past Incidents

Thursday 6th June 2019

No incidents reported

Wednesday 5th June 2019

Compute Nodes [Scaleway] AMS - Provisioning instabilities

We encountered an outage with our provisioning system.
If you are currently trying to create an instance, it might be stuck in 'provisioning state'.
Our team is working on a fix.

===================

05/06/2019 1720Z (1820LT)

The issue has been fixed. You may now create an instance without any problem.

05/06/2019 1650Z (1750LT)

The product team has identified the root cause and working on a fix

05/06/2019 1640Z (1740LT)

Issue has been escalated to the local team

Global Backbone [NETWORK] DC5 >> DC3

We have detected a fiber break on a span between TH2 and DC5.
Span between DC5 and DC3 is still up and traffic still flows through this optical path with 400G capacity.
We are investigating with our dark fiber provider.

This concerns both public and private (RPN) network.

===================

05/06/19 1510Z (1710LT)

Provider's maintenance still ongoing.
We don't have any specific ETA yet, we will keep monitoring the situation.

06/06/19 1000Z (1200LT)

Issue has been resolved

Tuesday 4th June 2019

Console Scaleway console and APIs unavailability

We are currently facing APIs unavailability on both AMS and PAR1.
Issue has been identified, we are working on a fix and will update this status as soon as we have additional details.

Please note that there is no impact on running services.
Issue is only affecting console's management and API calls (startup, stop, etc).

===================

04/06/19 1415Z (1615LT)

Issue is now closed, services are up and stable.
Thank you for your patience.

04/06/19 1400Z (1600LT)

A fix has been applied and deployed.
Services are slowly coming back to life, we are still monitoring the situation.

04/06/19 1345Z (1545LT)

issue has been identified by the product's teams.
We are working on an urgent fix.

Monday 3rd June 2019

DC5 [DC5] DC5 into degraded mode - No local technical support - No physical operations on site

The wind conditions have changed and there are some toxic gaz moving to the DC5.
The local team has been evacuated and we do not have people on site for now.
Services are running. In case of hardware failure on one of the servers, customer will have to migrate services on other servers.
We'll keep this status updated to say when we go back to normal.

UPDATE: DC5 is now back to normal. All operations can now be done and all technicians are on site

DC5 Network Router reboot impacting racks C36-C42 and D65-66

Our team noticed an unexpected reboot on a DC5 router managing trafic on the following racks :

  • C36 to C42
  • D65 and D66

As we currently have no technical team on site, we are trying to identify the root cause from remote access and logs.
Services are already back online, but we are still investigating.

Sunday 2nd June 2019

DC5 [DC5] Fire threat

This morning, a fire has started on the building next to our DC5 datacenter. Authorities are on site and currently fighting against the fire. We are heavily mobilized to monitor the situation and keeping our datacenter safe.

Authorities have warned us about chemical products being stored in this neighbor building. There is an explosion threat for the moment.

We will keep this status updated as soon as we get informations. For the moment, all services are reachable.

Scaleway compute instances are not concerned.

Concerned services: Dedibox Dedicated Servers hosted in DC5 and Scaleway Object Storage in Paris region

UPDATE 1: Fire is still ongoing, authorities are working hard on containing it.
UPDATE 2: There is a slight improvement over the fire. We are still on alert.
UPDATE 3: The fire is now under control.
UPDATE 4: Fire is now extinguished. We are still heavily watching this.
UPDATE 5: Incident is now over. No downtime or damages happened on our datacenter due to this.

Saturday 1st June 2019

No incidents reported

Friday 31st May 2019

No incidents reported