Some systems are experiencing issues

About This Site

Maintenances and incidents regarding our services, networks and datacenters can be followed here.

Scheduled Maintenance
[Amsterdam core router bb2.ams1] Router upgrade

Location : Amsterdam - Core router bb2.ams1
What is done : Upgrade Software and Reload bb2.ams1 to fix FlowSpec issues. Rollback : rollback to previous release
Expected Impacts : None, traffic should be rerouted elsewhere.

Preparation - duration 2h

-start time : 26-Feb-2020 0500Z (0600LT)
-end time : 26-Feb-2020 0700Z (0800LT)

Full upgrade - duration 4H

-start time : 27-Feb-2020 0300Z (0400LT)
-end time : 27-Feb-2020 0700Z (0800LT)

[DC3] Scheduled maintenance in Room 3-4 / Racks : C1>C22 - D1>D21

A scheduled maintenance is planned in part of the room 3-4, DC3, in order to optimize and upgrade our infrastructure. The impacted racks are : C1>C22 - D1>D21

As a result servers will lose their public network connectivity as our router is being upgraded, but private network connectivity will still be functional. Public network will be back online once the update is complete.

If your server is in the said racks, you will receive a ticket on your account.

Start : March 3rd, 2020 - 0400Z (0500LT)

Duration : 90 minutes

[DC2] Scheduled maintenance in Room 205 / Racks : C1>C8 - D1>D8 - E1>E7

A scheduled maintenance is planned in part of the room 205, DC2, in order to optimize and upgrade our infrastructure. The impacted racks are : C1>C8 - D1>D8 - E1>E7

As a result servers will lose their public network connectivity as our router is being upgraded, but private network connectivity will still be functional. Public network will be back online once the update is complete.

If your server is in the said racks, you will receive a ticket on your account.

Start : March 3rd, 2020 - 0530Z (0630LT)

Duration : 90 minutes

[DC3] Scheduled maintenance in Room 4-6 / Racks : A1>A23 - B1>B23

A scheduled maintenance is planned in part of the room 4-6, DC3, in order to optimize and upgrade our infrastructure. The impacted racks are : A1>A23 - B1>B23

As a result servers will lose their public network connectivity as our router is being upgraded, but private network connectivity will still be functional. Public network will be back online once the update is complete.

If your server is in the said racks, you will receive a ticket on your account.

Start : March 4th, 2020 - 0400Z (0500LT)

Duration : 90 minutes

UPDATE:

2/12/2020 - 0410Z (0510LT)

Racks A1>A23 are upgraded and functional

[DC3] Scheduled maintenance in Room 4-6 / Racks : C1>C22 - D1>D22

A scheduled maintenance is planned in part of the room 4-6, DC3, in order to optimize and upgrade our infrastructure. The impacted racks are : C1>C22 - D1>D22

As a result servers will lose their public network connectivity as our router is being upgraded, but private network connectivity will still be functional. Public network will be back online once the update is complete.

If your server is in the said racks, you will receive a ticket on your account.

Start : March 4th, 2020 - 0530Z (0630LT)

Duration : 90 minutes

[DC2] Scheduled maintenance in Room 101 / Racks : A20>A28 - B20>B26 - L31>L37 - K37

A scheduled maintenance is planned in part of the room 101, DC2, in order to optimize and upgrade our infrastructure. The impacted racks are : A20>A28 - B20>B26 - L31>L37 - K37

As a result servers will lose their public network connectivity as our router is being upgraded, but private network connectivity will still be functional. Public network will be back online once the update is complete.

If your server is in the said racks, you will receive a ticket on your account.

Start : March 5th, 2020 - 0400Z (0500LT)

Duration : 90 minutes

[DC2] Scheduled maintenance in Room 203A / Racks : M1>M14 - N1>N6

A scheduled maintenance is planned in part of the room 203A, DC2, in order to optimize and upgrade our infrastructure. The impacted racks are : M1>M14 - N1>N6

As a result servers will lose their public network connectivity as our router is being upgraded, but private network connectivity will still be functional. Public network will be back online once the update is complete.

If your server is in the said racks, you will receive a ticket on your account.

Start : March 5th, 2020 - 0530Z (0630LT)

Duration : 90 minutes

[DC2] Scheduled maintenance in Room 205 / Racks : A1>A8 - B1>B8 - G2>G8 - H2

A scheduled maintenance is planned in part of the room 205, DC2, in order to optimize and upgrade our infrastructure. The impacted racks are : A1>A8 - B1>B8 - G2>G8 - H2

As a result servers will lose their public network connectivity as our router is being upgraded, but private network connectivity will still be functional. Public network will be back online once the update is complete.

If your server is in the said racks, you will receive a ticket on your account.

Start : March 10th, 2020 - 0400Z (0500LT)

Duration : 90 minutes

[DC3] Scheduled maintenance in Room 3-5 / Racks : E1>E21 - F1>F21

A scheduled maintenance is planned in part of the room 3-5, DC3, in order to optimize and upgrade our infrastructure. The impacted racks are : E1>E21 - F1>F21

As a result servers will lose their public network connectivity as our router is being upgraded, but private network connectivity will still be functional. Public network will be back online once the update is complete.

If your server is in the said racks, you will receive a ticket on your account.

Start : March 10th, 2020 - 0530Z (0630LT)

Duration : 90 minutes

[DC3] PLC and HMI software update on chains F1 and F2for mobile chillers power supply supervision

[DC3] PLC and HMI software update on chains F1 and F2for mobile chillers power supply supervision

As part of the mobile chillers installation work, we will update PLC and HMI softwares on chains F1 and F2. The modifications affect the supervision of mobile chillers breakers (display, alarms).

All the changes that will be made will only be one electrical chain at a time. Under no circumstances will two electrical chains be modified simultaneously.

Impact : none for customers

Start : 12-Mar-2020 0700Z 0800LT

Duration : 1 day

[DC3] Preventive maintenance of CRAC units

We will carry out the semi-annual preventive maintenance of CRAC units according to the schedule below. CRAC units will be shut down one at a time, so as not to impact the cooling of halls. Each IT zone has CRAC unit called « backup » : each CRAC unit is doubled. Each MVLB hall has a main air hanling unit (AHU).

The maintenance will be done according to the following schedule :

  • MLVBs 27/03/2020 and 30/03/2020
  • Operators halls : 20/03/2020
  • IT halls n°4 : 16 and 17/03/2020
  • IT halls n°3 : 18 and 19/03/2020
  • IT halls n°2 : 23 to 25/03/2020
  • IT halls n°1 : 25 and 26/03/2020

Impacts on services : Loss of cooling redundancy during the preventive maintenance operation of a CRAC unit. No impact on the cooling of facilities. The maximum cut-off time per CRAC unit is otherwise defined at 1 hour.

[DC3] Maintenance of electric generators

Location : DC3

What is done : We’re going to realize the preventive electrical maintenance of generators, the maintenance will be performed electrical chain by electrical chain :

Chain A : 23/03/30
Chain B : 24/03
Chain C : 25/03
Chain D : 26/03
Chain F1 : 30/03
Chain F2 : 31/03

Start : 23-Mars-2020 0730Z (0830LT) End : 31-Mars-2020 0430Z(0530LT)

Impact : Degradation of electrical redundancy Duration 6 days

[DC3] Pressurization maintenance

[DC3] Pressurization maintenance

We will realized a pressurization maintenance on substation SSA, SSB and SSC

Impact : none

Start : 31-Mar-2020 0830Z 0930LT
End : 2-Apr-2020 1600Z 1700LT

Duration : 3 days

Past Incidents

Wednesday 29th January 2020

[DC5] Maintenance on Generator set, scheduled 3 weeks ago

[DC5] Preventive mechanical maintenance of generating sets

Location : DC5 What is done : We will carry out generator maintenance according to this planing:

GE BAT 1: 01/29 GE LT1.2: 01/30 GE LT1.1: 01/31

Impact : No impact is to be expected.

Start : 29-Jan-2020 0700Z 0800LT

Duration : 3 days

Thursday 9th January 2020

[Database] Scheduled maintenance on all running instances, scheduled 1 month ago

Our Database team is scheduling an infrastructure upgrade on all RDB instances.
We expect a short downtime on both classic and HA databases.

All instances will be updated progressively in a 3-hour window.

Impact :

  • A few seconds downtime on HA RDB instances.
  • ~1min downtime on other RDB instances.
Start : 09-Jan-2020 between 0600Z (0700LT) and 0800Z (0900LT)
[AMS] Network Load balancer API, scheduled 1 month ago

[AMS] Network Load balancer API

We are launching an API maintenance on our Loadbalancer product.

Impact : API will not be accessible during maintenance. The loadbalancers are not impacted.

Start : 09-JAN-2020 0700Z 0800LT

Duration : 10 minutes

Wednesday 8th January 2020

No incidents reported

Tuesday 7th January 2020

Web Abnormally long SSL certificate creation times

We have noticed a delay in the SSL certificate generation time. Our teams are currently working to solve this problem.

Please do not hesitate to contact Support if you have any questions regarding this issue.

===================

07.01.2020 1335Z (1435LT)

The product team has identified the root cause and working on a fix

07.01.2020 1335Z (1435LT)

Issue has been escalated to local team

Monday 6th January 2020

Global Backbone Backbone - France-IX issues

We observed some packet loss on FRANCE-IX.

We have isolated the traffic and rerouted it through transits or other IXs.

===================

07.0120 1100 (1200LT)

Issue has been fixed, we are monitoring it on our side but everything should be back online. Do not hesitate to contact our support team should you have any issue

06.0120 1450 (1550LT)

The product team has identified the root cause and working on a fix

06.0120 1340 (1440LT)

Issue has been escalated to local team

Console Archlinux installations

We have detected an issue with the Archlinux installations, which ended with an error. We are currently working on its resolution.

===================

01.06.2020 1400Z (1500LT)

A fix has been deployed, new installations will now work as expected

01.06.2020 0610Z (0710LT)

The product team has identified the root cause and working on a fix

01.06.2020 0610Z (0710LT)

Issue has been escalated to local team

[SCALEWAY] PAR C2 Instances Unavailability

Our teams have identified an issue that affects some C2 instances in the Paris region.

Affected instances are unreachable and administrative actions (stop, reboot, etc.) on these do not work properly and get stuck.

===================

02.06.20 0330Z (0430LT)

Issue has been escalated to local team

02.06.20 0710Z (0810LT)

The issue is now fixed.

Sunday 5th January 2020

No incidents reported

Saturday 4th January 2020

Console [SCALEWAY] Console Instabilities

We are currently experiencing some slowdowns on the Scaleway console.

The "instances" page may return timeouts and not load, the API may give errors.

===================

01.04.20 0645Z (0745LT)

Issue has been escalated to local team

01.04.20 1115Z (1215LT)

Issue has been fixed

Friday 3rd January 2020

Mail [MAIL] Email sending issues

We have detected problems on our SMTP servers that cause issues with the sending of emails from our hosting platforms. It might not be possible to send emails from your addresses.

===================

01.03.23 1640Z (1740LT)

We are still noticing instabilities with the SMTP servers, the team is investigating.

01.03.20 1423Z (1523LT)

SSL certificate has been updated and the issue is now fixed.

01.03.20 1400Z (1500LT)

There is a certificate issue on the SMTP server currently, we are investigating.

01.03.20 1330Z (1430LT)

Issue has been fixed and emails are now being sent correctly.

01.03.20 1100Z (1200LT)

Issue has been escalated to local team

DC3 Network Network outage on DC3 room 3 3-3, Bay : C22

We are currently facing a network outage on DC3 room 3 3-3, Bay : C22

All servers concerned by this location are down.

The switch has been replaced and configuration is now done. Relaunching a DHCP lease might be necessary to gain access back to the public network.

===================

01.03.20 0748Z (0848LT)

New switch is configured and working

01.03.20 0718Z (0818LT)

The switch has been replaced and is being configured

01.03.20 0000Z (0100LT)

Issue has been escalated to local team

Thursday 2nd January 2020

Web WEB - Statistics 2020

Web interface is not showing new year's 2020 statistics.

Our team has been notified and is now investigating.

===================

15/01/20 1000Z (1100LT)

The fix has been deployed, you need to refresh the statistics of your website using the "Refresh" button

02/01/19 0700Z (0900LT)

The product team is working on a fix