https://blog.cloudflare.com/cloudflare-service-outage-june-1...
https://downdetector.com/ is showing outages at many major companies including Google, CloudFlare, AWS and more.
Word on the street is that there are large BGP routing issues behind all of this.
GCP is also down https://news.ycombinator.com/item?id=44260810
Yeah this is going to be a problem. I haven't seen an issue this widespread across so many services in a while.
Let me guess, someone pushed out a bad BGP config?
Big blog post about how they saved the internet upcoming. ;)
Currently down, but reference: https://blog.cloudflare.com/the-ddos-that-almost-broke-the-i...
Seems to be affecting functionality of their "Verify you are human" dialogs as well as Workers.
They've changed the title to "Broad Cloudflare service outages"
Is it coincidence that there's a Scheduled Maintenance in Tokyo for 18:00 UTC in progress, and the problems started at 18:19 UTC?
Cloudflare's lava lamps are dimming.
Can’t wait to read this post-mortem. Seems odd that a Google Cloud outage would bring down Cloudflare services.
They updated the incident noting that it's not just authentication affected.
Our Workers apps are up again
edit:
It works in the US but EU customers are still reporting our services as down.
edit:
EU customers are reporting ok
distributed systems break, that’s the whole point what actually matters is how fast they localize damage and how invisible that feels to the end user if kv failing takes down auth, ui, and workers, then failure isolation’s missing recovery is fine, but if your fix needs global coordination to unbreak local flows, that’s a design smell not saying perfect uptime, but the post-outage ux should feel smoother, not shakier right now it feels like the system survived but the interface didn’t
So both Cloudflare authentication as well as Google's identity systems suffered major dowtime yesterday. Are there technical dependecies between these?
Workers KV has been down for like +30mins. This is impacting us seriously.
Their API is down too.
Amazing that something can impact their whole infrastructure like this given how much redundance they have.
proxy seems available in general, must just be local to workers because only one of my sites going thru ZT tunnel with identity access rules is affected
solar flare?
Hopefully they also publish the prompt that did this.
> Cloudflare’s critical Workers KV service went offline due to an outage of a 3rd party service that is a key dependency.
So they depend on GCP for (some of) their services