.png "back to home page")
but Facebook runs EVERYTHING through Facebook
— alex hern (@alexhern) October 4, 2021
Instagram are on AWS Route53, and they're also down (no resolution). pic.twitter.com/NGAlwaVpZl
— Kevin Beaumont (@GossiTheDog) October 4, 2021
It isn't right that a single company holds the only key to what millions of people around the world consider to be vital infrastructure. If you in anyway make your living online, I hope yesterday served as a grave warning. https://t.co/EyGDBcUwxG
— Reni Eddo-Lodge (@renireni) October 5, 2021
? hello!
— WhatsApp (@WhatsApp) October 4, 2021
Facebook says the outage was due to a 'faulty configuration change' and has apologised to its 3.5 billion users. https://t.co/KQJGJuunpP
— NewstalkFM (@NewstalkFM) October 5, 2021
After being asked a bunch, the best metaphor I got for what’s going on is that somebody mistakenly removed a bunch of signs on the highway. The roads and bridges are totally fine and once the crews repair the signs, the Facebook empire will be back on the Internet again. https://t.co/dToMvy8CU5
— vint serp (@ZackMaril) October 4, 2021
Also, props for authorship and having an infra exec take ownership of the outage. Never an easy thing to do, and would've been an easy out to have it come from some generic The Facebook Team or something like that.
— Conor L. Myhrvold ? (@conormyhrvold) October 5, 2021
Facebook (accidentally, we assume) sent an update to a deep-level routing protocol on the internet that said, basically, "hey we don't have any servers any more xoxo"
— alex hern (@alexhern) October 4, 2021
twitter rn kinda has the vibe of when they turn the lights off during an assembly and everyone starts making noises
— rob ?? (@catholicdad420) October 4, 2021
another factor adding to the chaos: per a Source, Facebook employees can't receive external emails right now
— rat king (@MikeIsaac) October 4, 2021
i imagine this will not make it easier to get things back online
Latin America lives on WhatsApp. I am surprised by so many people underestimating how catastrophic this downfall has been.
— José Caparroso (@JoseCaparroso) October 4, 2021
"[F]or [people] worldwide whose personal and professional lives play out on WhatsApp, the instant messaging app’s blackout was more than a mere inconvenience. [WhatsApp is a popular alternative where] telecommunications can be prohibitively expensive." https://t.co/IA3y8cQPQr
— Robert Caruso (@robertcaruso) October 5, 2021
how much? https://t.co/fH0zXw7rV9
— jack⚡️ (@jack) October 4, 2021
It also shows that Facebook is a monopoly we simply cannot live without, as I argued during the outage over Twitter, Slack, Discord, Google Talk, iMessage, and Signal. https://t.co/7nFoWt8wBA
— Sam Bowman (@s8mb) October 5, 2021
"We also have no evidence that user data was compromised as a result of this downtime."
— Donie O'Sullivan (@donie) October 5, 2021
Facebook, WhatsApp, and Instagram all going down at the same time sure seems like an easily-understandable and publicly-popular example of why breaking up a certain monopoly into at least three pieces might not be a bad idea.
— Edward Snowden (@Snowden) October 4, 2021
Somebody should tell Elizabeth Warren.
By not having BGP announcements for your DNS name servers, DNS falls apart = nobody can find you on the internet.
— Kevin Beaumont (@GossiTheDog) October 4, 2021
Same with WhatsApp btw.
Facebook have basically deplatformed themselves from their own platform.
About five minutes before Facebook's DNS stopped working we saw a large number of BGP changes (mostly route withdrawals) for Facebook's ASN. pic.twitter.com/dMTevg6hqj
— John Graham-Cumming (@jgrahamc) October 4, 2021
We’re coming back online! Thank you all for your patience and we sincerely apologize to everyone affected by the outage. https://t.co/0ivNTHJ9wd
— Facebook App (@facebookapp) October 4, 2021
Very interesting read, there's much to learn. Even when you're prepared to everything that could come in (very smart people's) mind, this kind of outage can happen.
— Loic Nasello (@loic_na) October 5, 2021
It reminds me plane and nuclear industries, very mature ones today. Datacenter industry is still learning https://t.co/Y8zT7sxMZS
When Instagram & Facebook are down. pic.twitter.com/mVFlVOOCOC
— Netflix (@netflix) October 4, 2021
Between 15:50 UTC and 15:52 UTC Facebook and related properties disappeared from the Internet in a flurry of BGP updates. This is what it looked like to @Cloudflare. pic.twitter.com/PFw5FR2W5j
— John Graham-Cumming (@jgrahamc) October 4, 2021
So, someone deleted large sections of the routing....that doesn't mean Facebook is just down, from the looks of it....that means Facebook is GONE. pic.twitter.com/OCZWPD2okw
— The Academy (@BenjaminEnfield) October 4, 2021
Facebook went down because of all the things you said about it
— Casey Newton (@CaseyNewton) October 4, 2021
Zuck weighs in on the outage: "Sorry for the disruption today -- I know how much you rely on our services to stay connected with the people you care about." pic.twitter.com/6MIPQYGZeU
— Alex Kantrowitz (@Kantrowitz) October 4, 2021
"We want to make clear at this time we believe the root cause of this outage was a faulty configuration change. We also have no evidence that user data was compromised as a result of this downtime."
— briankrebs (@briankrebs) October 5, 2021
People making jokes about the Facebook services going down make me sick. Anyone who was using an Oculus headset at the time is currently trapped in VR, and if they die there then they die in real life.
— Gavin Young (@GavinDYoung) October 4, 2021
On today’s episode of Cascading Failures - “Our systems are designed to audit commands like these to prevent mistakes like this, but a bug in that audit tool didn’t properly stop the command” https://t.co/xp2ZIzuWub
— Jeff Sussna (@jeffsussna) October 5, 2021
We’re aware that some people are having trouble accessing Facebook app. We’re working to get things back to normal as quickly as possible, and we apologize for any inconvenience.
— Facebook App (@facebookapp) October 4, 2021
You know what the best part of my day is? It's for about ten seconds when I log into Facebook. 'Cause I think maybe I'll just get a 'this site can't be reached.' No goodbye, no 'see ya later', no nothin'. You just left. I don't know much, but I know that. pic.twitter.com/dJQecllv6E
— Christopher Mathias (@letsgomathias) October 4, 2021
Facebook has dispatched a small team to one of its California data centers to try and manually reset its servers in an attempt to fix the problem.
— rat king (@MikeIsaac) October 4, 2021
(It's chaos to even try to contact folks, but people are resorting to zoom, discord etc) https://t.co/nb06SFdmR3
“Facebook said in a blog post Monday night that the six-hour outage that took it offline along with Instagram, Messenger, Whatsapp, and OculusVR was the result of a configuration change to its routers — not of a hack or attempt to get at user data” https://t.co/iMrnIkMEqa
— Phumzile Van Damme (@zilevandamme) October 5, 2021
Yesterday’s outage across our products was a bad one, so we’re sharing some more detail here on exactly what happened, how it happened, and what we’re learning from it: https://t.co/IXRt572h4c
— Mike Schroepfer (@schrep) October 5, 2021
hello literally everyone
— Twitter (@Twitter) October 4, 2021
Here's our best explanation from what we can see on how @Facebook disappeared from the Internet: https://t.co/zHMzESp9SW
— Matthew Prince ? (@eastdakota) October 4, 2021
They took down Finsta
— Peter Hamby (@PeterHamby) October 4, 2021
Facebook service outage is really a great data point for the argument that we should not have a global social media platform that dominates multiple lines of communication actoss various countries and regions
— Edward Ongweso Jr (@bigblackjacobin) October 4, 2021
— maxi (@lavenderdys) October 4, 2021
A bunch of Facebook networks has just disappeared from the internet: pic.twitter.com/j07LrmAAdW
— Giorgio Bonfiglio (@g_bonfiglio) October 4, 2021
We’re aware that some people are having trouble accessing our apps and products. We’re working to get things back to normal as quickly as possible, and we apologize for any inconvenience.
— Facebook (@Facebook) October 4, 2021
Was just on phone with someone who works for FB who described employees unable to enter buildings this morning to begin to evaluate extent of outage because their badges weren’t working to access doors.
— Sheera Frenkel (@sheeraf) October 4, 2021
To the huge community of people and businesses around the world who depend on us: we're sorry. We’ve been working hard to restore access to our apps and services and are happy to report they are coming back online now. Thank you for bearing with us.
— Facebook (@Facebook) October 4, 2021
Signups are way up on Signal (welcome everyone!) We also know what it’s like to work through an outage, and wish the best for the engineers working on bringing back service on other platforms #mondays
— Signal (@signalapp) October 4, 2021
Now that our services are fully restored, we are sharing more details about yesterday's outage. https://t.co/SwDmBGZaZU
— Facebook Engineering (@fb_engineering) October 5, 2021
a bunch of friends have texted me asking for a basic explanation as to what the hell happened to knock off all of Facebook so:
— alex hern (@alexhern) October 4, 2021
woah that was quick pic.twitter.com/xt9IWCip5j
— Joe Groff (@jckarter) October 4, 2021
October is now BGP Awareness Month.
— Eva (@evacide) October 4, 2021
I see this whole system of allowing giant social media monopolies to control multiple critical modes of communication is working out well.
— Krystal Ball (@krystalball) October 4, 2021
Everyone showing up to @Twitter today while @Facebook @instagram @WhatsApp are down like... pic.twitter.com/SGtr722FAo
— Dolly Parton (@DollyParton) October 4, 2021
Lmao. Friend at Facebook confirmed they ended up bringing in a guy with an angle grinder to get access to the server cage
— Cullen (@cullend) October 4, 2021
Signal is WhatsUp
— jack⚡️ (@jack) October 4, 2021
? https://t.co/zpRrxf9qKP https://t.co/T23l7Ih6NQ
I do appreciate Chrome’s absolutely idiotic guess about what’s going on pic.twitter.com/bt3jGYcMK3
— Casey Newton (@CaseyNewton) October 4, 2021
mark zuckerberg just texted me on signal, said facebook took everything down so that all the news stories this week would be about downtime and not the whistleblower on 60 minutes. boy genius
— jenn schiffer (@jennschiffer) October 4, 2021
Facebook-owned Whatsapp being down is a reminder that you and your friends should probably be using a more private, non-profit alternative like @Signalapp anyway (or another open-source app of your choice).
— Edward Snowden (@Snowden) October 4, 2021
It's just as free, and takes like 30 seconds to switch.#facebookdown
Yep, a configuration change indeed!
— Cindy Sridharan (@copyconstruct) October 5, 2021
A mini postmortem of today’s Facebook outage is now up. https://t.co/Xp3iKvhH5b https://t.co/7ihRLgn0rj pic.twitter.com/G9bW9O4zOp
WhatsApp is down. Not sure how much longer British politics will last tbh
— Lewis Goodall (@lewis_goodall) October 4, 2021
me trying to get in contact with people with WhatsApp down pic.twitter.com/cciMdyfIaV
— Sophie Hall-oween ? (@SophLouiseHall) October 4, 2021
Confirmed: The DNS records that tell systems how to find https://t.co/qHzVq2Mr4E or https://t.co/JoIPxXI9GI got withdrawn this morning from the global routing tables. Can you imagine working at FB right now, when your email no longer works & all your internal FB-based tools fail?
— briankrebs (@briankrebs) October 4, 2021
Them fighting words… but it does feel like a snow day.
— Adam Mosseri ? (@mosseri) October 4, 2021
Very interesting insight into the major outage yesterday although I can’t help thinking why is there a function of automation to shut down the whole backbone…
— Jonathan Steward (@ggjono) October 5, 2021
How is that command even possible, what’s the use case?! https://t.co/1veMMfJAdM
thought this was supposed to be encrypted…
— jack⚡️ (@jack) October 4, 2021
The repercussions of WhatsApp being down in The Rest Of The World are vast and devastating. It's like the equivalent of your phone and the phones of all of your loved ones being turned off without warning. The app essentially functions as an unregulated utility.
— Aura Bogado (@aurabogado) October 4, 2021
Telegram says it added 70 million users while Facebook and WhatsApp were down https://t.co/PAEEbhgQr7
— TechCrunch (@TechCrunch) October 5, 2021
Instagram and friends are having a little bit of a hard time right now, and you may be having issues using them. Bear with us, we’re on it! #instagramdown
— Instagram Comms (@InstagramComms) October 4, 2021
Facebook’s Workplace and internal site are also having DNS issues
— Jane Manchun Wong (@wongmjane) October 4, 2021
where can FB employees file the SEV now? pic.twitter.com/wjCCviEccL
Facebook brought Oculus down with them ? pic.twitter.com/rfapj1yaSU
— Julien Dorra (@juliendorra) October 4, 2021
If Facebook’s monopolistic behavior was checked back when it should’ve been (perhaps around the time it started acquiring competitors like Instagram), the continents of people who depend on WhatsApp & IG for either communication or commerce would be fine right now. Break them up.
— Alexandria Ocasio-Cortez (@AOC) October 4, 2021
FB and IG being down in the US for a day is probably not a huge deal.
— Will Oremus (@WillOremus) October 4, 2021
WhatsApp being down for a day in the many countries where it is the primary online communication platform is a huge deal. https://t.co/nOFQDAEEaD
As our platforms are coming back online, we wanted to share some more information about today’s outage and what caused it. https://t.co/JkZnn2I37g
— Facebook Engineering (@fb_engineering) October 5, 2021
At 15:40 BGP started learning at a geometric rate, at 15:52 UTC it became sentient. At 15:54, thinking that Asimov's 3 laws of robotics sounded like a decent idea, BGPnet shut dowm Facebook.
— Ian Miers (@secparam) October 4, 2021
Context for US folx- WhatsApp being down means total disconnect for many in the global south- it’s not just for calling and texting, but sending & receiving money too. #WhatsAppDown
— Hana Baba (@radiohana) October 4, 2021
Not only are Facebook's services and apps down for the public, its internal tools and communications platforms, including Workplace, are out as well. No one can do any work. Several people I've talked to said this is the equivalent of a "snow day" at the company.
— Ryan Mac ? (@RMac18) October 4, 2021
Facebook has, um, "written a postmortem" https://t.co/xg6U3hU4Bl
— ☠️ Jean Yang ? (@jeanqasaur) October 5, 2021
FB: Configuration changes on backbone routers that coordinate network traffic between our data centers caused issues that interrupted this communication. This had a cascading effect on the way our data centers communicate, bringing our services to a halt. https://t.co/JuPjc4YNUD
— briankrebs (@briankrebs) October 5, 2021
Here's the full post:https://t.co/ca22XZmzhZ
— Donie O'Sullivan (@donie) October 5, 2021
Facebook updates its engineering blog post on the outage Monday, saying it wasn't a malicious attack — just a screw uphttps://t.co/6mjJOdaJj8
— rat king (@MikeIsaac) October 5, 2021
Facebook confirms outages was due to core router misconfigs https://t.co/6Z5EkPavG9
— The Best Linux Blog In the Unixverse (@nixcraft) October 5, 2021
More info on the outage today: https://t.co/D54G0PLaqk
— Mike Schroepfer (@schrep) October 5, 2021
Facebook Engineering blog is out. Core network failure from config change. https://t.co/HYHDX3286B pic.twitter.com/b076U3v3T2
— Kevin Beaumont (@GossiTheDog) October 5, 2021
Facebook engineers on today’s outage:
— Dare Obasanjo (@Carnage4Life) October 5, 2021
Configuration changes on the backbone routers that coordinate network traffic between data centers caused the issue. This disruption to network traffic had a cascading effect on the way the data centers communicate. https://t.co/rRatFNDIYS
Here's the Facebook Engineering statement on what caused outages on Facebook, Instagram and What's App. Also, "no evidence that user data was compromised as a result". https://t.co/A0Dg7nYHIG
— Eugene Ramirez (@EugeneRamirez) October 5, 2021
A “faulty configuration change” blew up the de facto (and, critically, zero rated for many data costs) face of the African internet yesterday, and I expect that’s all we’ll hear of that. https://t.co/HgI1xVFZJS https://t.co/UDVcf9XU94
— Joseph Cotterill (@jsphctrl) October 5, 2021
An update to Facebook’s statement made yesterday about the outage:
— Mikael Thalen (@MikaelThalen) October 5, 2021
“We want to make clear that there was no malicious activity behind this outage — its root cause was a faulty configuration change on our end.” https://t.co/tKlLGdt6sz
FB have put out an extremely vague explanation. Was it a configuration error on their part, or a bug in the router? https://t.co/Dsn6T0KUtD
— Laurie Voss (@seldo) October 5, 2021
It was not DNS. https://t.co/Frq2P21PMP
— Russ Garrett (@russss) October 5, 2021
On March 13, 2019 Facebook had a 4+ hour outage - we are almost at the four hour mark on this one - https://t.co/8jHY12KI3J story from 2019 by @amygesenhues
— Barry Schwartz (@rustybrick) October 4, 2021
Once upon a time I used to write about days like today: https://t.co/vCDKQIGIzG
— amy gesenhues (@amygesenhues) October 4, 2021
Check it. Facebook, WhatsApp and Instagram are slowly returning. Why did they disappear to begin with? https://t.co/TLfTrWnb9R via @techcrunch #tech #digital #data #privacy
— Kohei Kurihara -DataPrivacy for Fighting Covid-19- (@kuriharan) October 5, 2021
Facebook, WhatsApp and Instagram are slowly returning. Why did they disappear to begin with? https://t.co/juMCxa9JV5
— The Cyber Security Hub™ (@TheCyberSecHub) October 4, 2021
https://t.co/BYb4JMungE for those who want to learn about routing/BGP and a piece of “the internet backbone”
— Aurora Intel (@AuroraIntel) October 4, 2021
For those of a techy nature who may not be very familiar with the inner workings of BGP, AS & DNS - this is a great explanation (HT @Cloudflare) as to what caused the FB outage yesterday. https://t.co/f2RAJfIzh5
— Christian Reilly (@reillyusa) October 5, 2021
Understanding How Facebook Disappeared from the Internet https://t.co/0a0YrqiFXn
— Kara Swisher (@karaswisher) October 4, 2021
good technical explainer of what happened in the fb/ig/wa outagehttps://t.co/ILI9cSjQCs
— lokman tsui (@lokmantsui) October 5, 2021
This is the best article we will find on the Facebook power outage https://t.co/XeyIiK6MG8
— Baptiste Robert (@fs0c131y) October 4, 2021
It’s always DNS…
— Troy Hunt (@troyhunt) October 4, 2021
“Understanding How Facebook Disappeared from the Internet” https://t.co/noie82nKC3
Understanding How Facebook Disappeared from the Internet - ? ? ? https://t.co/cNBMTKYCz2
— John Murch (@johnmurch) October 4, 2021
Great article from Cloudflare how #Facebook & co disappeared from the Internet yesterdayhttps://t.co/FL5BtpliRp
— Piotr Stapp (@ptrstpp950) October 5, 2021
This is a great article about what happened yesterday regarding Facebook: https://t.co/noONvKs9hT
— Michael Plöd (@bitboss) October 5, 2021
And here's an excellent explanation from @Cloudflare, if you would like more technical details:https://t.co/9UAhJwQzw0
— elena silenok (@silenok) October 5, 2021
If you're looking for a deeper dive on how FB disappeared from the Internet, the @Cloudflare team put up a helpful investigative blog post this morning: https://t.co/DtMBlhV6nc
— Stephanie Wong (@stephr_wong) October 4, 2021
Understanding How Facebook Disappeared from the Internet by @tstrickx and @celso.https://t.co/CF036d9iT3
— Nick Sullivan (@grittygrease) October 4, 2021
Understanding How Facebook Disappeared from the Internet@cibernicola_es @as_informatico@sc0rp1oXD @AzagraMac @JLNavarroAdam @lordman1982https://t.co/9HRdI7lUcb
— Ciberconsejo (@ciberconsejo) October 5, 2021
23/ CloudFlare has a post on this https://t.co/pqadyZrkeg
— Robᵉʳᵗ Graham #PcapsOrItDidntHappen (@ErrataRob) October 5, 2021
Nice writeup from @cloudflare
— Subbu Allamaraju (@sallamar) October 4, 2021
“Today's events are a gentle reminder that the Internet is a very complex and interdependent system of millions of systems and protocols working together” thanks to the “trust, standardization and cooperation” https://t.co/zRwNCV2JrQ
Understanding How Facebook Disappeared from the Internet by @Cloudflare https://t.co/GR9ijrsDiv
— Idriss Neumann ∞ ? ? ☸️ (@idriss_neumann) October 5, 2021