DigitalOcean Services Status
LON1 Networking
Incident
Report for DigitalOcean
Resolved
Impact: minor;
From 20:20 - 23:25, we experienced a partial outage of VPC traffic in our LON1 region. This outage was triggered by an underlying bug uncovered by the maintenance activities in https://status.digitalocean.com/incidents/pqsgdmyzyy0k.
Public networking was unaffected, but Load Balancers, Managed Kubernetes Clusters, Managed Databases, App Platform, Functions, and Droplet-to-Droplet traffic flowing via VPC was impacted.
We sincerely apologize for the disruption triggered by the maintenance activities we performed. We've successfully run this maintenance in multiple regions without any impact, but going forward, we will ensure the bug discovered here is not present before rolling out the upgrades to the remaining regions.
Affected Components: Services - Networking Regions - LON1
Status: resolved
2023-02-03 01:22 UTC
-
Our Engineering team has confirmed the mitigation was successful and traffic is flowing normally again. Services dependent on VPC traffic were impacted, which include Load Balancers, Managed Databases, Managed Kubernetes Clusters, App Platform, and Functions. We've also confirmed the impact from this outage was triggered by the activities in the maintenance here: https://status.digitalocean.com/incidents/13xcycr2cdy0
We're now monitoring and will post an update once we confirm this issue is fully resolved.
Affected Components: Services - Networking Regions - LON1
Status: monitoring
2023-02-03 00:04 UTC
-
Mitigation efforts are now 100% complete and we are seeing restoration of connectivity. We're confirming with multiple Engineering teams that the mitigation was successful and will post an update soon.
Affected Components: Services - Networking Regions - LON1
Status: identified
2023-02-02 23:38 UTC
-
Our Engineering team has identified the root cause of the issue and is now mitigating it. These efforts are approximately 35% complete. We'll continue to post updates.
Affected Components: Services - Networking Regions - LON1
Status: identified
2023-02-02 23:31 UTC
-
Our Engineering team has confirmed impact to Load Balancers, Managed Databases, Managed Kubernetes Clusters, and App Platform. Connectivity directly to Droplets does not appear to be affected.
Affected Components: Services - Networking Regions - LON1
Status: investigating
2023-02-02 23:26 UTC
-
Our Engineering team is currently investigating reports of connectivity issues in our LON1 region. Maintenance is ongoing as per https://status.digitalocean.com/incidents/pqsgdmyzyy0k and we are working to determine if the root cause is related to that maintenance. At this time, users may see timeouts and errors when connecting to services in LON1.
We'll post an update with further information as soon as possible.
Affected Components: Services - Networking Regions - LON1
Status: investigating
2023-02-02 23:07 UTC
-
Incident Created at: 2023-02-02 23:07 UTC Resolved at: 2023-02-03 01:22 UTC
From 20:20 - 23:25, we experienced a partial outage of VPC traffic in our LON1 region. This outage was triggered by an underlying bug uncovered by the maintenance activities in https://status.digitalocean.com/incidents/pqsgdmyzyy0k.
Public networking was unaffected, but Load Balancers, Managed Kubernetes Clusters, Managed Databases, App Platform, Functions, and Droplet-to-Droplet traffic flowing via VPC was impacted.
We sincerely apologize for the disruption triggered by the maintenance activities we performed. We've successfully run this maintenance in multiple regions without any impact, but going forward, we will ensure the bug discovered here is not present before rolling out the upgrades to the remaining regions.
Affected Components: Services - Networking Regions - LON1
Status: resolved
2023-02-03 01:22 UTC
-
Our Engineering team has confirmed the mitigation was successful and traffic is flowing normally again. Services dependent on VPC traffic were impacted, which include Load Balancers, Managed Databases, Managed Kubernetes Clusters, App Platform, and Functions. We've also confirmed the impact from this outage was triggered by the activities in the maintenance here: https://status.digitalocean.com/incidents/13xcycr2cdy0
We're now monitoring and will post an update once we confirm this issue is fully resolved.
Affected Components: Services - Networking Regions - LON1
Status: monitoring
2023-02-03 00:04 UTC
-
Mitigation efforts are now 100% complete and we are seeing restoration of connectivity. We're confirming with multiple Engineering teams that the mitigation was successful and will post an update soon.
Affected Components: Services - Networking Regions - LON1
Status: identified
2023-02-02 23:38 UTC
-
Our Engineering team has identified the root cause of the issue and is now mitigating it. These efforts are approximately 35% complete. We'll continue to post updates.
Affected Components: Services - Networking Regions - LON1
Status: identified
2023-02-02 23:31 UTC
-
Our Engineering team has confirmed impact to Load Balancers, Managed Databases, Managed Kubernetes Clusters, and App Platform. Connectivity directly to Droplets does not appear to be affected.
Affected Components: Services - Networking Regions - LON1
Status: investigating
2023-02-02 23:26 UTC
-
Our Engineering team is currently investigating reports of connectivity issues in our LON1 region. Maintenance is ongoing as per https://status.digitalocean.com/incidents/pqsgdmyzyy0k and we are working to determine if the root cause is related to that maintenance. At this time, users may see timeouts and errors when connecting to services in LON1.
We'll post an update with further information as soon as possible.
Affected Components: Services - Networking Regions - LON1
Status: investigating
2023-02-02 23:07 UTC
-
Incident Created at: 2023-02-02 23:07 UTC Resolved at: 2023-02-03 01:22 UTC