Control Plane for Multiple Services
Resolved
Our Engineering team identified and resolved an issue impacting multiple services, in multiple regions.
From 19:53 - 20:22 UTC, users may have experienced errors with the following operations, for all regions:
Droplet creates with a root password
Droplet root password resets
Droplet Snapshots
MongoDB cluster creates
Let’sEncrypt certificate creation (for Load Balancers and Spaces)
LoadBalancer creation with certificates
Spaces bucket and key creations
Fetching CSV invoices
Bulk actions in the Spaces UI
Additionally, users could have seen latency while creating and updating Apps.
Our Engineering team quickly identified the root cause of the incident to be an incorrect firewall policy applied to core infrastructure and rolled back the change.
We apologize for the disruption. If you continue to experience any issues, please open a Support ticket from within your account.
Posted Jul 02, 2024 - 21:09 UTC
This incident affected: Spaces (AMS3, FRA1, NYC3, SFO2, SFO3, SGP1, SYD1, BLR1), App Platform (Global), Event Processing (Global), Managed Databases (AMS3, BLR1, FRA1, LON1, NYC1, NYC2, NYC3, SFO2, SFO3, SGP1, SYD1, TOR1), Billing, Cloud Control Panel, Load Balancers (AMS2, AMS3, BLR1, FRA1, LON1, NYC1, NYC2, NYC3, SFO1, SFO2, SFO3, SGP1, SYD1, TOR1), and Droplets (AMS2, AMS3, BLR1, FRA1, LON1, NYC1, NYC2, NYC3, SFO1, SFO2, SFO3, SGP1, SYD1, TOR1).