Some systems are experiencing issues

About This Site

Maintenances and incidents regarding our services, networks and datacenters can be followed here.

Scheduled Maintenance
[DC5] Scheduled Maintenance - Software upgrade

A scheduled maintenance is planned in DC5 in order to upgrade our optical transmission infrastructure.

The nature of this work is to perform a software upgrade just on one of our DWDM equipment units.

Impact: no production downtime during the maintenance window.

Updates will be posted below as the maintenance is going on.

Start : December 03st, 2020 - 08:00 UTC

Duration : 2 hours

[DC3] Preventive maintenance of CRAC units

We will carry out the semi-annual preventive maintenance of CRAC units according to the schedule below.
CRAC units will be shut down one at a time, so as not to impact the cooling of halls.

Each IT zone has CRAC unit called «backup»: each CRAC unit is doubled.
Each MVLB hall has a main air hanling unit (AHU).

The maintenance will be done according to the following schedule:
• MLV​Bs: 09/12/2020 to 11/12/2020
• Operators halls: 04/12/2020
• IT halls n°4: 07/12/2020 and 10/12/2020
• IT halls n°3: 07/12/2020 and 09/12/2020
• IT halls n°2: 08/12/2020
• IT halls n°1: 08/12/2020

The maximum cut-off time per CRAC unit is otherwise defined at 1 hour.

Impact: Loss of cooling redundancy during the preventive maintenance operation of a CRAC unit (max 1h). No impact on the cooling of facilities.

Supervision of return and blowing temperatures during operation. Interventions mastered by the maintainer with the possibility of returning very quickly in initial configuration in the event of anomaly.

In the event of fault not immediately correctible and impacting the operation of the “backup” CRAC unit associated with the CRAC unit in maintenance, the maintainer will restart the CRAC unit in maintenance very quickly. If necessary, CRAC units adjacent to the faulty zone may be switched to degraded (forced) operation.

Start: 2020-12-04 0730Z (0830LT)
End: 2020-12-11 1730Z (1830LT)

Duration: 6 business days

[DC5] Scheduled maintenance Room 1 - Racks B5, B9, B10, B11

A scheduled maintenance is planned in DC5 (Room 1 - B5, B9, B10, B11) in order to optimize and upgrade our infrastructure.

It will be done gradually on the racks, in the same order as in the object of the maintenance.

As a result servers will lose their public network connectivity as our switches are being upgraded, but private network connectivity will still be functional. It will come back gradually following the scheduled upgrades. We estimate the downtime to be between 20 and 30 minutes.

Updates will be posted below as the maintenance is going on.

Start : December 09th, 2020 - 06:00 UTC

Duration : 2 hours

Past Incidents

Thursday 15th October 2020

[ROUTER] Core router maintenance - Upgrade, scheduled 1 month ago

Location : Paris - Core router bb2.dc3

What is done : Upgrade hardware and reload bb2.dc3 to enable new 100G ports.

Impact : None expected, traffic will be rerouted elsewhere.

Upgrade - duration 4h

  • Start time : 15-Oct-2020 0200 UTC (0400 UTC+2)

  • End time : 15-Oct-2020 0430 UTC (0630 UTC+2)

Wednesday 14th October 2020

[ROUTER] Core router maintenance - Preparation, scheduled 1 month ago

Location : Paris - Core router bb2.dc3

What is done : Upgrade hardware and reload bb2.dc3 to enable new 100G ports.

Impact : None expected, traffic will be rerouted elsewhere.

Preparation - duration 2h

  • Start time : 14-Oct-2020 0300 UTC (0500 UTC+2)

  • End time : 14-Oct-2020 0500 UTC (0700 UTC+2)

Tuesday 29th September 2020

[ROUTER] Core router maintenance - Preparation, scheduled 2 months ago

Location : Paris - Core router bb1.dc3

What is done : Upgrade hardware and reload bb1.dc3 to enable new 100G ports.

Impact : None expected, traffic will be rerouted elsewhere.

Preparation - duration 2h

  • Start time : 29-Sept-2020 0300 UTC (0500 UTC+2)

  • End time : 29-Sept-2020 0500 UTC (0700 UTC+2)

Friday 4th September 2020

No incidents reported

Thursday 3rd September 2020

[Instance] Scheduled maintenance on nl-ams, scheduled 2 months ago

Our Instance team is scheduling a maintenance on Amsterdam Availability zone. The maintenance will be done in a 4-hour window.

Impact: Any action taken on servers will not complete until the maintenance is over

Start: 03-Sept-20 0730Z (0930LT)

Duration: 4 hours

[Webhosting] - Issue with Databases

We are currently facing an issue with a few shared hostings related to their databases platform

Our team is working on it

We will update this status as soon as we have more information

===================

09.03.2020 1640Z (1840LT)

Issue has been fixed by our engineers. If problems remain, please contact our support team.

09.03.2020 1430Z (1630LT)

Issue has been escalated to local team

DC3 Network [RPN-DC3] RPN down rack D22/S31/DC3

Dedibox servers in rack D22-S33 in DC3 are impacted.

RPN is impacted, public network isn't impacted.

===================

2020.09.03

The switch at the origin of the incident has been replaced and function is nominal again

2020.09.03 0800Z (1000LT)

Issue has been escalated to local team.

Wednesday 2nd September 2020

[WEB HOSTING] E-Mail Account Update

E-Mail Account updates are unavailable, including:

  • new account creation
  • account password update

===================

09.02.20 1200Z (1400LT)

Issue has been fully solved, contact assistance if needed

09.02.20 1041Z (1241LT)

The issue has been partially resolved, our team continues to fix the platforms of the last affected customers

09.02.20 0930Z (1130LT)

Issue has been escalated to local team

Tuesday 1st September 2020

[DC3] Pressurization maintenance, scheduled 3 months ago

We will perform pressurizing stations maintenance on substations SSA, SSB, and SSC:

  • Substation C, 01/09 and 02/09
  • Substation A & B, 02/09 and 03/09

Impact: None

Start: 01-Sep-2020 0730Z (0930LT)
End: 03-Sep-2020 1500Z (1700LT)
Hosting [WEB HOSTING] Mail service failure

We're currently experiencing an issue on one of our mail server. Impacts for customers are:

  • access to webmail,
  • reception of new email

However, outgoing mails are not impacted.

===================

09.02.20 0930Z (1130LT)

UPDATE: The issue has been fixed - The correction were made on the impacted platform

09.01.20 1900Z (2100LT)

Update: some mailboxes are currently inaccessible. The issue has been escalated to our local team.

09.01.20 1430Z (1630Z)

Update: Some delay persists in email reception.

08.31.20 1210Z (1410LT)

Issue has been escalated to local team

08.31.20 1035Z (1235LT)

Issue has been escalated to local team

Monday 31st August 2020

DC5 [DEDIBOX] Install process stucked on DC5

We're currently experiencing an issue on our DC5 global PXE, and all installations on DC5 are stuck.

===================

08.31.20 1519Z (1719LT)

Issue has been solved by our engineers

08.31.20 1500Z (1700LT)

Issue has been escalated to local team

[WEB HOSTING] Webmail access issues

We are currently facing an issue with our webmail platform.

===================

2020-08-31 01205Z (1405LT)

Issue is fixed, do not hesitate to contact our support team should you experience another issue.

2020-08-31 0930Z (1130LT)

Issue has been escalated to local team

Sunday 30th August 2020

Global Backbone Level3 network outage

Our teams have been alerted that Level3 is currently experiencing issues, resulting in higher latencies and traffic blackholes.
Issue has been escalated to our Network team, we are working on a workaround to enhance transit normally going through Level3.

Status will be updated as soon as we have additional details.

===================

30/08/20 1530Z (1730LT)

Issue seems to be fixed on Level3 end.
We are progressively reactivating traffic through Level3.

30/08/20 1420Z (1620LT)

There appears to be a global consensus from large transit providers to workaround the issue on their side and they are now removing Level3 from their peering, we should expect improvements in connectivity (outside of Level3's reach at least).

30/08/20 1255Z (1455LT)

We have done what we can to clear our way from Level3 misbehavior but, as their network is not processing BGP updates, it is getting very hard to workaround their global failure.
We are monitoring the situation closely and will keep working on what we can, waiting for Level3 to get it fixed on their end.

30/08/20 1200Z (1400LT)

Level3 has been moved out of our transit mix while it is still very unstable.
However, you may still experience side effects globally with other providers, as it may result with saturations on other transits.

30/08/20 1120Z (1310LT)

Our network team acknowledged the issue, working on a temporary solution.

Saturday 29th August 2020

No incidents reported