Some systems are experiencing issues

About This Site

Maintenances and incidents regarding our services, networks and datacenters can be followed here.

Scheduled Maintenance
[MAINTENANCE DC5-A] Racks D14;D15;D16;D17;D18;D19;C1;C2;C3;C4;C7;C8

A scheduled maintenance is planned in DC5-A with a physical displacement of your servers listed above in order to optimize and upgrade our infrastructure. Servers will be unavailable for the duration of the maintenance detailed below.

This status will be updated as the operations are going through to keep you informed about the events.

Start : July 6th, 2020 - 2000UTC (2200LT)

End : July 7th, 2020 - 0300UTC (0500LT)

[MAINTENANCE DC5-A] Racks H1;H2:H3;H4;H5;H6;H7;H8;H9;H10;H11;H12;H13;H14;H15;H16;H17

A scheduled maintenance is planned in DC5-A with a physical displacement of your servers listed above in order to optimize and upgrade our infrastructure. Servers will be unavailable for the duration of the maintenance detailed below.

This status will be updated as the operations are going through to keep you informed about the events.

Start : July 15th, 2020 - 2000UTC (2200LT)

End : July 16th, 2020 - 0300UTC (0500LT)

[DC5] Load test of generators

[DC5] Load tests of generators

As part of the preventive maintenance of the Datacenter, we will proceed to a redundancy test of the Datacenter infrastructure by carrying out generator tests.

The operation consists in simulating a cut of electrical TGBT and validate load recovery as well as function through generators. Running time on the generators will be reduced in view of the low load on the site.

Impact : None expected

Start: 16-Jul-2020 0600Z (0800LT)
End: 16-Jul-2020 1200Z (1400LT)
[DEDIBOX] API and Console session handler migration

[DEDIBOX] API and Console session handler migration

We'll migrate our Console and API session handler.

Console and API will be unavailable during the migration process.

Start : 25-Jun-2020 0300Z 0500LT

Duration : 30 min

[DC3] Semi-annual maintenance of chillers

[DC3] Semi-annual maintenance of chillers

We will do the semi-annual maintenance of the chillers, according to the manufacturer’s maintenance range.
Operations will be performed by the manufacturer and supervised by our maintainer, according to the following previsional schedule:

  • Monday 17/08: Chiller n°1, Substation A
  • Tuesday 18/08: Chiller n°2, Substation A
  • Wednesday 19/08: Chiller n°3, Substation A
  • Thursday 20/08: Chiller n°4, Substation B
  • Friday 21/08: Chiller n°5, Substation B
  • Monday 24/08: Chiller n°6, Substation B
  • Monday 31/08: Chiller n°7, Substation C
  • Tuesday 01/09: Chiller n°8, Substation C

Substations A and B supply the chilled water network of the computer halls.
Substation C supplies the chilled water network of the operators halls and the air handling units.

Impact : None expected

Start: 17-Aug-2020 0630Z (0830LT)
End: 01-Sep-2020 0330Z (0530LT)
[DC3] Load tests of generators and PLC software updates

[DC3] Load tests of generators and PLC software updates

As part of the preventive maintenance of the Datacenter, we will proceed to a redundancy test of the Datacenter infrastructure by carrying out generator tests chronologically on the following electrical chains : A / B / C / D / F1 and F2.

During the load tests on the electric chains A / B / C and D, we will proceed to F1 line up backup test.
Description of operations :

  • 25/08/2020:
    • Morning: Load test on the electric chain A with F1 line up backup test.
    • Afternoon: Load test on the electric chain B with F1 line up backup test.
  • 26/08/2020:
    • Morning: Load test on the electric chain C with F1 line up backup test.
    • Afternoon: Load test on the electric chain D with F1 line up backup test.
  • 27/08/2020: As part of the mobile chillers installation, we will update PLC software on chains F1 and F2. After we will proceed to load test on the chains F1 andF2.

During the F1 line up backup test, we will simulate a failure of the generators in order to validate the F1 lineup backup scenario.Our teams and usual maintenance companies will be mobilized for the perfect workflow.

Impact : None expected

Start: 25-Aug-2020 0600Z (0800LT)
End: 27-Aug-2020 1600Z (1800LT)

Past Incidents

Monday 10th February 2020

[Amsterdam core router bb1.ams1] Router upgrade, scheduled 4 months ago

Location : Amsterdam - core router bb1.ams1

What is done : Upgrade Software and Reload bb1.ams1 to fix FlowSpec issues. Rollback to previous release.

Impact : None expected, traffic will be rerouted elsewhere.

Preparation - duration 2h

  • start time : 10-Feb-2020 0500Z (0600LT)
  • end time : 10-Feb-2020 0700Z (0800LT)

Full upgrade - duration 4h

  • start time : 11-Feb-2020 0300Z (0400LT)
  • end time : 11-Feb-2020 0700Z (0800LT)

Thursday 30th January 2020

[DC3] Load tests of generators, scheduled 5 months ago

As part of the preventive maintenance of the Datacenter, we will proceed to a redundancy test of the Datacenter infrastructure. The operation consists of simulating a power failure on the MVLBs and validating the electrical load recovery and working on generator for 4 hours. Our teams and usual maintenance companies will be mobilized for the perfect workflow.

This intervention does not present any particular risk of service interruption and will be processed on worked hours.

Start: 2020-01-30 0800Z (0900LT)
End: 2020-01-30 1500Z (1600LT)

Duration: 7 hours

Monday 27th January 2020

[DC3] Maintenance of chillers, scheduled 5 months ago

[DC3] Maintenance of chillers

Location: DC3

What is done: We will do the semi-annual maintenance of the chillers, according to the following schedule :

Chiller n°8: 27/01
Chiller n°7: 28/01
Chiller n°1: 29/01
Chiller n°2: 30/01
Chiller n°3: 31/01
Chiller n°4: 03/02
Chiller n°5: 04/02
Chiller n°6: 05/02

Impact: No impact is to be expected.

Start: 27-Jan-2020 0730Z 0830LT
End: 05-Feb-2020 1630Z 1730LT

Duration : 8 days

Tuesday 14th January 2020

No incidents reported

Monday 13th January 2020

[DC3] Maintenance of generators, scheduled 5 months ago

[DC3] Preventive mechanical maintenance of generators

We will carry out generator maintenance according to this planning:

Chain A: 13/01
Chain B: 14/01
Chain C: 15/01
Chain D: 16/01
Chain F1: 17/01
Chain F2: 20/01

No impact is to be expected.

Start: 2020-01-13 0700Z (0800LT)
End: 2020-01-21 1630Z (1730LT)

Duration: 8 days

Console Random 500 Internal Server Error on some console's pages

Our teams noticed 500 errors generated on various page on console.
Root cause has not been identified yet, investigations are currently being conducted.

We will update this status as soon as we have additional details.

===================

13/01/20 1600Z (1700LT)

Issue has now been fixed.
We are truly sorry for any inconvenience caused.

13/01/20 1400Z (1500LT)

Issue has been escalated to product team.

Databases [WEBHOSTING] Databases unavailability

Some database platforms are unavailable, and as a result, databases hosted on those platforms are unreachable.

===================

01.13.20 0930Z (1030LT)

Issue has been escalated to local team

===================

01.13.20 1120Z (1220LT)

The issue is now fixed. Do not hesitate to contact our support if you have any questions.

Sunday 12th January 2020

No incidents reported

Saturday 11th January 2020

Web [Web Hosting] - Load balancer issue

We are having an issue on one of our Web hosting's load balancer. The result is that all websites under this load balancer are not reachables. We are working on fixing it at the moment

===================

01.11.2020 1000Z (1200LT)

Issue has been escalated to local team

01.11.2020 1040Z (1240LT)

Issue is now fixed

Friday 10th January 2020

Global Backbone Traffic issue through Zayo

We received multiple reports regarding traffic issue through zayo.par.franceix.net.
We are currently investigating the issue with the network provider, and will update this status as soon as we have additional details.

===================

10/01/20 1420Z (1520LT)

Our network partner confirmed that the issue has now been fixed.
Traffic has been rerouted normally and latence should be good again.
Should you still face any issue, please get in touch with our support team by ticket.

10/01/20 1120Z (1220LT)

Traffic is temporarily being rerouted through AMS-IX.
Network performance is lower than expected, but it allows us to improve reachability while we are working on the issue with the network provider.

10/01/20 1030Z (1130LT)

Issue has been escalated to our Network team.
Awaiting further updates.

Thursday 9th January 2020

[AMS] Network Load balancer API, scheduled 5 months ago

[AMS] Network Load balancer API

We are launching an API maintenance on our Loadbalancer product.

Impact : API will not be accessible during maintenance. The loadbalancers are not impacted.

Start : 09-JAN-2020 0700Z 0800LT

Duration : 10 minutes

Wednesday 8th January 2020

No incidents reported