Some systems are experiencing issues

About This Site

Maintenances and incidents regarding our services, networks and datacenters can be followed here.

Scheduled Maintenance
[DC3] Preventive maintenance of contactors

We're going to perform preventative maintenance on the refrigeration units at DC3. These will be stopped 1 by 1, only the redundancy is degraded.

The maintenance will be done according to the following schedule :

Start: 04.06.2020: 0800Z (0900LT) End: 04.08.2020: 1500Z (1600LT)

Impacts on services : Loss of cooling redundancy during the preventive maintenance

[DC3] Semi-annual maintenance of distribution pumps

[DC3] Semi-annual maintenance of distribution pumps

We will do the semi-annual maintenance of the distribution pumps.Operations will be performed by our maintainer under our permanent supervision, according to the following previsional schedule:

Tuesday 14/04 Sub-stationA
Wednesday 15/04 Sub-stationB
Thursday 16/04 Sub-stationC

Substations A and B supply the chilled water network of the computer halls.Substation C supplies the chilled water network of the operators halls and the air handing units.

Impact : None

Start : 14-Apr-2020 0800Z 0900LT
End : 16-Apr-2020 1700Z 1800LT

Duration : 3 Days

[DC3] Update PLC software - Generators load tests

[DC3] Update PLC software on F1/F2 chains and load test of generators on F1 / F2 chains

Load tests of generators on IT chains with F1 line up backup test

As part of the preventive maintenance of the Datacenter, we will proceed to a redundancy test of the Datacenter infrastructure by carrying out generator tests chronologically on the following electrical chains : A / B / C / D / F1 and F2. During the load tests on the electric chains A / B / C and D, we will proceed to F1 line up backup test.

Descripton of operations :

21/04/2020: Morning: Load test on the electric chain A with F1 line up backup test.

Afternoon: Load test on the electric chain B with F1 line up backup test.

22/04/2020: Morning:Load test on the electric chain C with F1 line up backup test.

Afternoon: Load test on the electric chain D with F1 line up backup test.

23/04/2020: As part of the mobile chillers installation, we will update PLC software on chains F1 and F2. After we will proceed to load test on the chains F1 andF2. During the F1 line up backup test, we will simulate a failure of the generators in order to validate the F1 lineup backup scenario. 

Our teams and usual maintenance companies will be mobilized for the perfect workflow.

Start : 21-Apr-2020 0700Z 0800LT
End : 23-Apr-2020 1700Z 1800LT

Duration : 3 Days

Past Incidents

Monday 6th April 2020

No incidents reported

Sunday 5th April 2020

No incidents reported

Saturday 4th April 2020

[RPN] Major maintenance between AMS <=> PAR, scheduled 1 day ago

Due to planned, major maintenance from our provider, RPN reachability between Amsterdam and Paris will be impossible.

We sincerely apologize for this inconvenience.

Impact: RPN AMS <=> PAR unavailability during the maintenance

Start: 04-Apr-2020 2159Z 2359LT
End: 05-Apr-2020 0400Z 0600LT
Duration: 6 hours (maximum)

Friday 3rd April 2020

Compute Nodes [Scaleway] DEV and GP instances not provisioning

DEV and GP instances not provisioning

DEV instances are not currently provisioning properly and can not be created.

===================

03/04/20 1600Z (1800LT)

Issue has been escalated to local team, that is working to fix the issue

03/04/20 1800Z (2000LT)

The issue has been solved

Compute Nodes [Scaleway] C2 instances functioning issues

We are currently facing a problem related to actions on C2 instances. There are no actions possible, as instances stuck, it includes booting or creation.

Impact: The creation of C2 instances is impossible, the starting of existing instances does not work.

Team in charge was already informed, they are investigating to find a solution as soon as possible. Our apologies for any inconvenience.

===================

03/04/2020 1400Z (1600LT)

Issue has been escalated to local team

Thursday 2nd April 2020

[Scaleway] Various instances functioning issues

We are having issues with various Scaleway instances in Paris. There are no actions possible, as instances stuck. It includes booting, snapshotting or creation. Team in charge was already informed, they are investigating to find a solution and restore all instances as soon as possible.

Our apologies for an inconvenience.

===================

02/04/2020 0555Z (0755LT)

Issue has been escalated to local team

02/04/2020 0720Z (0920LT)

Worker is now back online and servers are available again.

Wednesday 1st April 2020

[Instances] DNS resolvers update, scheduled 4 days ago

On the 2020-04-01 and over the following days we will start to update Paris Instances DNS resolvers.
All Instances running in Paris will be impacted.
The impact though is pretty low.

At some point your Instance DNS resolvers will go from 10.1.94.8 and 10.1.94.9 to 10.5.28.129 and 10.5.28.130.
The migration will be done progressively with no service interruption.

If you didn't customize your DNS servers, you don't have anything to do.
If you experience name resolution problems, only check that you use the newest resolvers and you will be good to go !

Global Backbone AMS-IX (Network provider) down

We have been informed that all ports from one of our Network provider (AMS-IX) are down.
We are currently investigating the issue with our provider.

Traffic should be rerouted to transits on other IX.
We are currently not experiencing any particular saturation on our network, but situation may change.
However, you may note some latency increase and possible saturation on peers side.

We will keep monitoring the situation closely.

===================

01/04/20 1650Z (1850LT)

Issue has been fixed by our network provider.
Trafic is now routed normally, everything is stable again.

01/04/20 1000Z (12000LT)

Issue acknowledged, investigating.

Console [DEDIBOX] Servers unable to install

We are currently facing an install issue on our dedibox. Installations are stuck at the beginning and will not process.

===================

01/04/20 1200Z (1400LT)

Issue is resolved, if your installation is still stuck, please restart it from your control panel

01/04/20 0945Z (1145LT)

Root cause has been found, install will be fixed progressively

01/04/20 0830Z (1030LT)

Investigations are still ongoing to resolve this issue as quickly as possible

01/04/20 0600Z (0800LT)

The product team has identified the root cause and working on a fix

Tuesday 31st March 2020

No incidents reported