Moritz
abadideaJune 2023: a Google data center in France floods and they call it a “water intrusion event”
March 2026: an Amazon data center in the Middle East is literally struck by a fucking ballistic missile in a hot war and they call it “impacted by objects”
I am sick and very out of it, as you might be able to tell by how I initially characterized a screenshot with a timestamp in March written right on it as February
DJGummikuh@0xabad1dea people killed by this war are probably taking a "leave of absence based on health issues"...
RolloTreadway@0xabad1dea I hope you feel better soon.
Greem (Graeme. Not Graham!)@0xabad1dea Sending good vibes your way. I hope you feel better soon.
Alex@0xabad1dea Sooo.. you had a calendar synchronization anomaly due to internal firmware instability? xD
@0xabad1dea At least OVH had the decency to call the Strasbourg fire a fire, not a thermal event.
sigi714@greem @0xabad1dea Its called Cloud upload ;)
CounterPillow@greem @0xabad1dea
Once saw someone make fun of a Hetzner support notice for plainly stating that an issue was fixed by re-plugging a partially unplugged power cable, and honestly props to Hetzner for not reaching for euphemisms there.
Once saw someone make fun of a Hetzner support notice for plainly stating that an issue was fixed by re-plugging a partially unplugged power cable, and honestly props to Hetzner for not reaching for euphemisms there.
Jernej Simončič �@0xabad1dea "… creating sparks and fire."
Claude Flammang
Sven@0xabad1dea if it was "literally struck by a ballistic missile" they'd not be talking about bringing it back up in a few hours...
NKT@HeNeArXn @0xabad1dea of course they would!
eestileib (she/hers)Ballistic Missile just means it finishes its burn relatively early (contrast to Cruise Missile eg).
There are many sizes and payloads, they aren't all nuclear.
@eestileib @HeNeArXn @0xabad1dea if it was a nuke, it wouldn't be back up any time soon. But it also wouldn't be from Iran. Israel or the US have nukes though. Neither are part of the worldwide nuclear monitoring program, unlike, er, Iran...
If it had been a nuke we would all either know, or be dead.
Tyrone Slothrop@HeNeArXn @0xabad1dea FWIW we’re currently at “full recovery is still expected to be many hours away”
Mx Rey (Fuck ICE) 💜 🏳️⚧️@slothrop @HeNeArXn @0xabad1dea latest update:
"We are expecting recovery to take at least a day, as it requires repair of facilities, cooling and power systems, coordination with local authorities, and careful assessment to ensure the safety of our operators."
yeah that's gonna take a bit
@HeNeArXn presumably the missile was not aimed directly at the data center but at something nearby. If your neighbor is exploded off the face of the earth by a missile and your power generator is taken out by the kinetic impact, you have been struck by a missile, you’re just luckily alive enough to complain about it
@0xabad1dea or its fragments from an intercepted missile or drone, or from something fired at an incoming missile, or bits from a plane, or ... and they might not even know yet what exactly it was. Hence, "objects".
JdeBPThe power generator was not taken out by any sort of impact, here, though. It was taken out by the fire department.
https://mastodonapp.uk/@JdeBP/116155667315973528
@wild1145
#UnitedArabEmirates #AWS #Amazon #CloudComputing #DataCentres #HansGruber
Ryan Wild@JdeBP @0xabad1dea @HeNeArXn Looks like the two UAE AZ's were due to drone strikes. AWS have updated their status at 4:19pm pst yesterday. It looks like it's the Bahrain regions az that was colatoral damage of drone strikes.
I don't think that there's actually a contradiction here between what they said earlier and later. The root cause is the missile strike, whereas the proximal cause was the fire department shutting off the power in response to the fire that that caused.
It's an interesting thing for a data centre customer to consider: In the event of a fire, gas leak, explosion, or some such, is the fire department going to, as S.O.P., shut off, without any grace period, *both* primary and backup power?
Because my reading of what #Amazon first wrote is that that is what the #UnitedArabEmirates fire department's response was: shut off all power, mains and backup generators, immediately.
Hence #HansGruber. (-:
It's not unreasonable of the fire department, but it's also salutary to remember that there are going to be cases, to DR plan for, where it is actually procedure to have an unclean shutdown of all machines at once.
@0xabad1dea @HeNeArXn @vmstan
#AWS #CloudComputing #DataCentres
@JdeBP Ah yes, I'd mis-read one of the earlier replies in the thread. I think part of why this is so noticeable is the AWS region is clearly a fairly small region, it's not super common now but in the newer regions especially having 3 Data centres mapping to 3 AZ's is not uncommon, but it does mean these sorts of things can have a much bigger impact.
This is the first time at least that I've found in AWS history that a region is significantly impaired due to effectively the loss of two geographically isolated AZ's (I don't remember from my time working there what the rules were around distance but they won't be exactly next door to one another!).
It'll be really interesting to see if everything can be recovered, given it's physical damage to the actual DC facilities there's likely to be a lot more work involved making the sites safe and getting it operational, it takes years to build these sites and they aren't exactly simple...
Hugo Mills@0xabad1dea "Impacted by Objects" is either my next band name, or doctors notes from the colorectal unit in the hospital.
velzard of jiraidon!!@darkling nobody to say it can't be both
- ice blue (he/him)
Тр3тий Сергеевич@0xabad1dea And I thought my government was acting cringe by calling gas leak explosion "a pop".
mbpaz@th3rdsergeevich @0xabad1dea "leaking some droplets and plasticine-like threads" (speaking about a fucking fully loaded tanker sunk, leaking heavy oil into the Atlantic)
Mariano Rajoy en 2002 sobre el Prestige "salen unos pequeños hilitos con aspecto de plastilina"
Stoneface Vimes@0xabad1dea so I guess if one burns down it'd be "influenced by a temperature event"
Andy FletcherMaybe they can knock out a few other data centres whilst they are about it. I'm open to suggestions.
v@0xabad1dea theres a kind of psych major who literally nerds out about this kind of thing. like "if you say x it creates y impression because z psychology reason" and i respect that but like sometimes....sometimes
cesium@0xabad1dea NARRATIVE FLOODGATES ACTIVATED
Viacheslav A@0xabad1dea This is a characteristic trait of authoritarian systems, which corporations inherently are. In Russian propagandists media they used to call explosion a "clap." No kidding, "a gas clap in residential building" has become a meme
Finn 🔜 #EF30@0xabad1dea irl dos attack
Impeach||GTFO 
@0xabad1dea tryin to get the insurance to pay.
@DaveFlater @0xabad1dea insurance generally excludes acts of war from coverage.
Fallout from a ballistic missile seems quite an act of war and I doubt "hey there was no war declaration" is enough to get a payment from them.
Fallout from a ballistic missile seems quite an act of war and I doubt "hey there was no war declaration" is enough to get a payment from them.
@mbpaz @0xabad1dea that's my point. They're going to say we don't know anything about a missile, something just fell on us, now please pay our claim.
@DaveFlater @0xabad1dea Being naive is not among the many many problems of insurance companies.
fuzzyfuzzyfungus@mbpaz @DaveFlater @0xabad1dea I'd be genuinely curious to know how that will work. Ballistic missiles are definitely nation-state coded in ways that truck bombs are not; but my understanding is that insurance contracts usually distinguish between 'war' other violent damage by legal status rather than delivery method.
I also think I've been told that the "Malayan Emergency" was so classified in order to try to avoid war-related insurance conditions, so it has been tried before.
@fuzzyfuzzyfungus @DaveFlater @0xabad1dea Back in 2001 right after 9/11 there was immediate relief among insurance companies when Bush appeared on TV declaring "This is an act of war". Later on, there were clarifications and they had to backtrack, but for a while, that was all they needed to refuse any claim.
Tor Lillqvist@0xabad1dea Fun, but do we actually know that the missile hit the data centre? A missile might have hit a neighbouring building, and the explosion then caused some large bits of concrete or whatever to hit the data centre.
ferricoxide@tml @0xabad1dea
Datacenters aren't usually built right next to other buildings (except other datacenters). I would more assume that it was literal debris from a fully- or partially-successful intercept. UAE does have Patriot missile batteries and the debris from an intercept has to go somewhere (and I'd assume that an actual/direct missile- or drone-strike would come with a different, more-significant status).
Datacenters aren't usually built right next to other buildings (except other datacenters). I would more assume that it was literal debris from a fully- or partially-successful intercept. UAE does have Patriot missile batteries and the debris from an intercept has to go somewhere (and I'd assume that an actual/direct missile- or drone-strike would come with a different, more-significant status).
@0xabad1dea Also, how do we know that it was a ballistic missile and not a drone?
Yes, I am fun at parties.
ave
🇨🇦️ badhairday@0xabad1dea "Welcome to Politically Correct 'ᴙ' Us." 😐
Martin Hamilton
CrazyDogLadySezPEACE@m @0xabad1dea badum *kish*! 🥁
Sounds like they're trying to avoid share prices tanking when these events happen.
terms of service 
@0xabad1dea linkedin recruiter speak
@0xabad1dea I see a zone-name like "mec1" and I assumed it was in mecca. Looks like it was in UAE, though?
AWS Data Center in UAE Hit by Fire After Objects Strike Facility Amid Regional Tensions - EconoTimes
Amazon Web Services (AWS) confirmed that one of its data centers in the United Arab Emirates experienced a temporary power shutdown after objects struck the facility, causing sparks and a fire. The incident occurred at...
@0xabad1dea @ferricoxide I think it means "Middle East central"
1.3.6.1.4.1.61513@0xabad1dea maybe should have corrected that bucket policy
Rairii 
@0xabad1dea ok now i'm imagining the opening strike of a war being on us-east-1
Colin Beveridge@Rairii We have always been at war with us-east-1.
Mark Lynch@icecolbeveridge @Rairii to be fair, if Iran did manage to hit us-east-1, would anyone believe the ensuing outage was actually war-related, as opposed to business as usual for AWS? 😜
Karl@0xabad1dea there's a word for that in every language, and English chose "cowardice".
Banda BassottiAll that effort busting unions, and a single strike still took out their data centre.
Angua 
@0xabad1dea
Data Centre Owners: dysfunction due to anatomical misalignment.
Data Centre Owners: dysfunction due to anatomical misalignment.
Guillotine Jones, Flâneur@0xabad1dea
Well, objects (large and explosive) DID strike the Amazon data center.
What's yer point?
(Here I'm being sarcastic.)
Well, objects (large and explosive) DID strike the Amazon data center.
What's yer point?
(Here I'm being sarcastic.)