Scaleway
[COCKPIT] Cockpit Scaleway Logs have high latencies on fr-par
Update - Slowdowns have resumed since 17:00.

Our team is currently investigating.
May 07, 2024 - 17:42 CEST
Update - Some customers may find it impossible to display their data. Our teams are currently investigating the situation.
May 03, 2024 - 20:16 CEST
Update - A bad index was found and fixed, services are back to normal. Will monitor.
May 03, 2024 - 16:09 CEST
Update - We are continuing to investigate this issue.
May 03, 2024 - 16:08 CEST
Update - Latency is back to normal for most query but query_range are still high latency, investigating
May 02, 2024 - 17:52 CEST
Investigating - Cockpit Logs cluster at fr-par is suffering and have high latencies.

Query to Scaleway generated logs may have timeouts

Our engineers are working on it
May 02, 2024 - 16:33 CEST
[MNQ] SQS/SNS unavailability on FR-PAR
Monitoring - The service is operationnal. We are continuing to monitor the issue.
May 06, 2024 - 09:46 CEST
Identified - The issue is back since 6:00 AM (CEST), we are working on a new fix.
May 06, 2024 - 09:16 CEST
Monitoring - The service is operationnal. We are continuing to monitor the issue.
May 04, 2024 - 15:54 CEST
Update - We are continuing to work on a fix for this issue.
May 04, 2024 - 15:44 CEST
Identified - SQS and SNS are down since 1:16 PM (CEST) on FR-PAR.
NATS should work but management through the Scaleway API does not work.
We're investigating.
May 04, 2024 - 15:44 CEST
[VPC] Newly created Private Networks on FR-PAR-2 do not communicate with the rest of FR-PAR
Monitoring - A fix has been implemented and we are monitoring the results.
Apr 22, 2024 - 20:16 CEST
Update - After further investigation, our team identified that newly attached ressources were also impacted.

Following a resolution process, VPC connectivity between fr-par-1 and fr-par-2 was interupted from 15:15 to 15:39 CEST.

Cockpit functionality is also affected.
Apr 22, 2024 - 16:07 CEST
Investigating - Our team is currently investigating the issue and has identified a potential root cause.
Apr 22, 2024 - 10:52 CEST
[BILLING] - PSP migration will make SEPA mandate creation/modification impossible for Elements
Investigating - On Monday, May 6th, from 2:00 PM to 3:00 PM (Paris time), it will not be possible to add, modify, or delete a SEPA direct debit mandate
May 02, 2024 - 13:11 CEST
[K8S] Migration to Private Networks for legacy public-only Kapsule clusters in FR-PAR
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 29, 2024 - 09:00 CEST
Update - Update: Scheduled for Apr 29, 2024 - May 10, 2024
Apr 29, 2024 09:00 - May 10, 2024 17:00 CEST
Scheduled - Kubernetes Kapsule clusters in the FR-PAR region with public-only endpoints will be migrated to Private Networks.

Network downtime: this migration will result in a temporary network loss of 1 to 10 minutes.

With the new default isolation configuration, worker nodes still have their public IPs to access the Internet. After migrating, existing security groups configuration won’t be overridden and RR wildcard DNS still point to public IPs.

Find our dedicated documentation on Kapsule with Private Networks https://www.scaleway.com/en/docs/containers/kubernetes/reference-content/secure-cluster-with-private-network/#how-can-i-migrate-my-existing-clusters-to-regional-private-networks
Apr 29, 2024 09:00 - May 10, 2024 17:00 CEST
Cannot push S3 logs to cockpit
Monitoring - The ingestion of logs and metrics has returned to normal, and we are currently monitoring the situation.
Apr 25, 2024 - 12:03 CEST
Identified - S3 logs are not sent to cockpit since 15h20 Paris time.
Apr 17, 2024 - 22:01 CEST
[Billing] Current consumption, invoice listing and public APIs are down
Monitoring - The functionalities are back in production. We're still monitoring the situation.
Apr 25, 2024 - 11:05 CEST
Investigating - An issue with our billing system make the current consumption, the invoice listing and the public APIs unavailable. Our team is already working on it to solve this incident as soon as possible.
Apr 25, 2024 - 08:25 CEST
[Cockpit] Scaleway metrics on nl-ams are not ingested
Update - Ingestion of product metrics on nl-ams, was unavailable from 00:00 to 10:00.
Apr 23, 2024 - 10:04 CEST
Update - Ingestion is back to normal, investigating.
Apr 22, 2024 - 13:55 CEST
Investigating - Scaleway metrics from nl-ams are not ingested, and will not appear in Cockpit.
Apr 22, 2024 - 09:33 CEST
[Webhosting] Blacklisted SMTP from Microsoft
Investigating - Our service is currently experiencing disruption due to blacklisting by Microsoft.
We are actively working with Microsoft to resolve this issue as soon as possible.
Apr 19, 2024 - 00:16 CEST
[AMS1] SD 94863 - SD 94880 are unreacheble
Identified - We have detected an issue on the server from SD 94863 to SD 94880 access and are unreachable, since 17.04.2024 15:12 UTC

The issue has been forwarded to our team for resolution.
Apr 18, 2024 - 01:34 CEST
[DEDIRACK] Opcore support unavailable
Update - You can still manage datacenter intervention from your dedibox console, in Housing
Dec 19, 2023 - 17:47 CET
Update - We are continuing to investigate this issue.
Dec 19, 2023 - 16:48 CET
Investigating - Ticketing directed to Opcore datacenters is currently unavailable to our dedirack clients.
Our team is currently investigating.
Dec 19, 2023 - 16:48 CET
[Dedibackup] issue on Dedibackup connections
Investigating - We have noticed that problems with connecting to the dedibackup service can occur.
We will get back to you as soon as we have more information on the situation.
Apr 06, 2023 - 12:23 CEST
Uptime over the past 90 days. View historical uptime.
Elements - AZ Degraded Performance
90 days ago
99.95 % uptime
Today
fr-par-1 Operational
90 days ago
99.78 % uptime
Today
fr-par-2 Operational
90 days ago
99.9 % uptime
Today
fr-par-3 Operational
90 days ago
99.9 % uptime
Today
nl-ams-1 Operational
90 days ago
100.0 % uptime
Today
pl-waw-1 Operational
90 days ago
100.0 % uptime
Today
nl-ams-2 Degraded Performance
90 days ago
100.0 % uptime
Today
pl-waw-2 Operational
90 days ago
100.0 % uptime
Today
nl-ams-3 Degraded Performance
90 days ago
100.0 % uptime
Today
pl-waw-3 Operational
90 days ago
100.0 % uptime
Today
Elements - Products Partial Outage
90 days ago
98.91 % uptime
Today
Instances Operational
90 days ago
99.99 % uptime
Today
BMaaS Operational
90 days ago
100.0 % uptime
Today
Object Storage Degraded Performance
90 days ago
99.96 % uptime
Today
C14 Cold Storage Operational
90 days ago
100.0 % uptime
Today
Kapsule Partial Outage
90 days ago
97.39 % uptime
Today
DBaaS Partial Outage
90 days ago
96.25 % uptime
Today
LBaaS Operational
90 days ago
99.99 % uptime
Today
Container Registry Operational
90 days ago
98.05 % uptime
Today
Domains Operational
90 days ago
100.0 % uptime
Today
Elements Console Partial Outage
90 days ago
95.75 % uptime
Today
IoT Hub Operational
90 days ago
99.99 % uptime
Today
Account API Operational
90 days ago
99.99 % uptime
Today
Billing API Partial Outage
90 days ago
95.75 % uptime
Today
Functions and Containers Operational
90 days ago
98.72 % uptime
Today
Block Storage Operational
90 days ago
100.0 % uptime
Today
Elastic Metal Operational
90 days ago
100.0 % uptime
Today
Apple Silicon M1 Operational
90 days ago
100.0 % uptime
Today
Private Network Operational
90 days ago
99.59 % uptime
Today
Hosting ? Operational
90 days ago
100.0 % uptime
Today
Observability Partial Outage
90 days ago
97.23 % uptime
Today
Transactional Email Operational
90 days ago
100.0 % uptime
Today
Jobs Partial Outage
90 days ago
81.96 % uptime
Today
Dedibox - Datacenters Operational
90 days ago
99.08 % uptime
Today
DC2 Operational
90 days ago
99.65 % uptime
Today
DC3 Operational
90 days ago
97.23 % uptime
Today
DC5 Operational
90 days ago
99.74 % uptime
Today
AMS Operational
90 days ago
99.7 % uptime
Today
Dedibox - Products Partial Outage
90 days ago
98.3 % uptime
Today
Dedibox Operational
90 days ago
92.78 % uptime
Today
Hosting Operational
90 days ago
100.0 % uptime
Today
SAN Operational
90 days ago
100.0 % uptime
Today
Dedirack Operational
90 days ago
100.0 % uptime
Today
Dedibackup Operational
90 days ago
100.0 % uptime
Today
Dedibox Console Operational
90 days ago
100.0 % uptime
Today
Domains Partial Outage
90 days ago
93.63 % uptime
Today
RPN Operational
90 days ago
100.0 % uptime
Today
Miscellaneous Operational
90 days ago
100.0 % uptime
Today
Excellence Operational
90 days ago
100.0 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

Scheduled Maintenance
[K8S] - Kubernetes 1.24 no longer supported on our Kubernetes products, migration to next supported version May 15, 2024 09:00-18:00 CEST
Clusters using 1.24 version will automatically be upgraded to 1.25.
Find more details in our version support policy: https://www.scaleway.com/en/docs/containers/kubernetes/reference-content/version-support-policy/
Posted on Apr 19, 2024 - 14:44 CEST
Past Incidents
May 8, 2024

No incidents reported today.

May 7, 2024
[Serverless Functions/Containers - FR-PAR] Upgrade on Paris infrastructure
Completed - The scheduled maintenance has been completed.
May 7, 19:25 CEST
Update - Accessing some custom domains in https might lead to certificate issues while the certificate is renewing. Custom domains might still be available in http during that time.
May 6, 16:30 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 6, 08:00 CEST
Scheduled - Due to an unavoidable upgrade to our Paris infrastructure, some Functions and Containers will be relocated during business hours (07:00 UTC => 17:00 UTC). Users might experience the following issues:

- Custom domains temporarily unavailable (404). This only affects the custom domain itself, the base functions/containers endpoint will continue to work as expected. Domain configuration can take up to 2 minutes (SSL certificate creation, ACME challenges), so the expected downtime is of the order of minutes. However, depending on the DNS propagation speed, and the TTL value configured on the domain, users may see a longer downtime.
- Custom domains might not be accessible in HTTPS (but will be in HTTP).
- Instances of functions/containers restarting. Note that this should not cause downtime, as old instances will continue to serve traffic until the new instances are up.
- Instances of functions/containers starting even if there is no traffic.

Sorry for any inconvenience.
May 3, 17:07 CEST
May 6, 2024
[DEDIBOX] - Switch down in DC2 - Room 101 - Zone 101 - Rack G29
Resolved - PSU replaced. 06/05/24
Servers and switch reachable.
May 6, 17:00 CEST
Investigating - We are currently investigating this issue.
May 4, 04:17 CEST
[DEDIBOX] - Maintenance on a DC2 switch Rack I35 in Room 101
Completed - The scheduled maintenance has been completed.
May 6, 12:05 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 6, 11:05 CEST
Scheduled - The servers on this rack will lose connectivity.
The switch will be replaced, as a hardware instability caused it to reboot last night, disrupting service for ~15min.
May 3, 11:09 CEST
May 5, 2024

No incidents reported.

May 4, 2024
May 3, 2024
May 2, 2024
[WEBHOSTING] Operating System Update on PL-WAW platform
Completed - The scheduled maintenance has been completed.
May 2, 16:00 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 2, 15:00 CEST
Scheduled - Various actions will be carried out:
- Updating system packages
- Kernel update
- Reboot

A 10-minute downtime is scheduled at the end of each maintenance.
Apr 30, 17:09 CEST
[WEBHOSTING] Operating System Update on NL-AMS platform
Completed - The scheduled maintenance has been completed.
May 2, 15:00 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 2, 14:00 CEST
Scheduled - Various actions will be carried out:
- Updating system packages
- Kernel update
- Reboot

A 10-minute downtime is scheduled at the end of each maintenance.
Apr 30, 17:08 CEST
[WEB HOSTING-CLASSIC FTP] Operating System Update
Completed - The scheduled maintenance has been completed.
May 2, 11:00 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 2, 10:00 CEST
Scheduled - Various actions will be carried out:
- Updating system packages
- Kernel update
- Reboot

A 10-minute downtime is scheduled at the end of each maintenance.
Apr 30, 16:54 CEST
[JOBS] - Temporary Serverless jobs interruption in fr-par region
Completed - The scheduled maintenance has been completed.
May 2, 09:30 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 2, 08:30 CEST
Update - We will be undergoing scheduled maintenance during this time.
Apr 30, 12:15 CEST
Scheduled - Due to a scheduled maintenance on May 2nd at 8:30 AM (CEST) in the fr-par region, serverless jobs will not be scheduled for up to one hour. During this period, jobs will be queued and will resume normal operation promptly after the maintenance window ends.
Apr 30, 11:35 CEST
May 1, 2024

No incidents reported.

Apr 30, 2024

No incidents reported.

Apr 29, 2024
[VPC] Configuration issue on some fr-par-2 hypervisors
Resolved - This incident has been resolved.
Apr 29, 17:23 CEST
Update - We are continuing to investigate this issue.
Apr 29, 17:21 CEST
Update - We are continuing to investigate this issue.
Apr 29, 17:14 CEST
Investigating - VPC not working at all on affected hypervisors.
Apr 29, 17:12 CEST
[KAPSULE] - Registry authentication issue
Resolved - This incident has been resolved.
Apr 29, 11:08 CEST
Monitoring - A fix has been implemented and we are monitoring the results.
Apr 29, 10:41 CEST
Investigating - Automatic authentication to project's registry from kapsule nodes experienced some issues
We are currently applying a fix
Apr 29, 10:34 CEST
Apr 28, 2024

No incidents reported.

Apr 27, 2024
[DC5] Switch Down in DC5 - Room 1 - Zone 1
Resolved - The switches have been replaced and everything is back up and running.
Apr 27, 11:28 CEST
Investigating - A public switch is down in [DC5] - Room 1 - Zone 1 - Rack A to E
Dedibox servers unreachable on Blocks A, B, C, D, E

We are currently investigating the issue.
Apr 27, 10:28 CEST
Apr 26, 2024
[Core Services] Maintenances on AZ
Completed - The maintenance will be postponed to a further date.
Apr 26, 23:26 CEST
Scheduled - All timestamps will be in CEST timezone

During these maintenance windows, you might experience temporary 500 errors from some products API.

The windows will start as following time and will last for up to 1 hour :

fr-par-1 :
- May 7th, 10am
- May 13th, 10 am

fr-par-2 :
- May 6th, 3pm
- May 7th, 10am

fr-par-3 :
- May 6th, 10am
- May 7th, 10am

nl-ams-1 :
- April 30th, 3pm
- May 2nd, 3pm

nl-ams-2 :
- April 29th, 3pm
- May 2nd, 3pm

nl-ams-3 :
- May 2nd, 3pm

pl-waw-1 :
- April 30th, 10am
- May 2nd, 10am

pl-waw-2 :
- May 2nd, 10am

pl-waw-3 :
- April 29th, 10am
- May 2nd, 10am
Apr 26, 17:50 CEST
Apr 25, 2024
[AMS] Switch AMS-1 Hall9 rack G9 down
Resolved - This incident has been resolved.
Apr 25, 15:48 CEST
Investigating - One of the switches on Hall9 rack G9 in the Amsterdam datacenter is not responding. Team in charge is investigating. Public interface of the servers on that switch on Hall9 rack G9 in that rack will be unresponsive at the current time
Apr 25, 15:17 CEST
[VPC] Loss of redundancy on VPC fr-par-2
Resolved - Redundancy is now restored on all services
Apr 25, 15:25 CEST
Investigating - Following an issue with a VPC router in fr-par-2, redundancy is lost while we troubleshoot the issue. Affected services are Regional Private Networks, Private Networks between Elastic Metal and Instances, and VPC managed services (DHCP, DNS, NTP, ...).

fr-par-1 and fr-par-2 are not affected, and no customer impact is expected.
Apr 24, 15:22 CEST
[DEDIBOX] - Switch down in AMS1 Hall 6 rack B53
Resolved - This incident is resolved
Apr 25, 14:28 CEST
Investigating - Dedibox switch located in AMS1 Hall 6 rack B53 is currently down
Apr 25, 10:20 CEST
[MSQ] - Messaging and Queuing: No cockpit metrics nor billing information generated since 3am.
Resolved - This incident has been resolved. However, data from 3:00 to 11:30 is lost (with potentially erroneous values from 10:40 to 11:30). Volume and storage for this period will be undercharged.
Apr 25, 12:05 CEST
Investigating - There is an issue with the intermediate database we use to prepare metrics and billing info.
Our team are working on solving the issue as soon as possible.
Apr 25, 11:00 CEST
[DC5] SWITCH DOWN in DC5 - Room 1 - Zone 1 - Rack A8
Resolved - This incident has been resolved.
Apr 25, 05:58 CEST
Monitoring - The switch is operational. The servers connected to the switch are once again reachable from the Internet.
Apr 25, 02:59 CEST
Update - The public switch was rebooted and regained connectivity to the network.
Apr 25, 01:25 CEST
Identified - The issue has been identified and a fix is being implemented.
Apr 25, 01:23 CEST
Investigating - A public switch is down in [DC5] - Room 1 - Zone 1 - Rack A to E
Dedibox servers unreachable on Blocks A, B, C, D, E
Apr 24, 22:16 CEST
Apr 24, 2024
[Serverless Functions/Containers - NL-AMS] Network connectivity issues
Resolved - This incident has been resolved.
Apr 24, 13:23 CEST
Monitoring - A fix has been implemented and we are monitoring the results.
Apr 23, 17:51 CEST
Investigating - Since around 2024-04-18 06:20 UTC, we have been experiencing network issues on our nl-ams infrastructure. Users with functions/containers in nl-ams region might experience the following:

- 5xx errors (or timeouts) when calling their function/container
- High latency when calling their function/container
- Sporadic network issues (e.g. DNS not resolving) for processes running in their function/container

We are investigating. Sorry for the inconvenience.
Apr 19, 17:05 CEST
Monitoring - A fix has been implemented and we are monitoring the results.
Apr 18, 18:58 CEST
Update - The scope of the incident is limited to a single cluster, so 50% of users in nl-ams should be affected. We are continuing to investigate.
Apr 18, 17:35 CEST
Update - We are continuing to investigate this issue. We are now following an hypothesis about some instances on nl-ams region affected by this issue.
Apr 18, 13:09 CEST
Investigating - Since around 2024-04-18 06:20 UTC, we are experiencing some network issues on our nl-ams infrastructure. Users with functions/containers in nl-ams region might experience the following:

- 5xx errors (or timeouts) when calling their function/container
- high latency when calling their function/container
- sporadic network issues (e.g. DNS not resolving) for processes running in their function/container

We are investigating. Sorry about the inconvenience.
Apr 18, 10:30 CEST
[PAR1] Flap of some RDB clusters
Resolved - This incident has been resolved.
Apr 24, 12:32 CEST
Investigating - An unexpected reboot or failover have been observed on some Managed database instances in FR-PAR at 10h06 UTC. The situation is stabilized and we are monitoring impacted clusters.
Apr 24, 12:32 CEST
← Incident History Powered by Atlassian Statuspage