bash0raOct 29
cR0w   
Watching companies like Microsoft and AWS continue to fuck up at massive scale and orgs are just like "what can you do?" and keep shoveling money to them is very exhausting.
Oct 29 at 5:43pmWeb
Show threadRootWyrm 🇺🇦Oct 29
@cR0w fucking up in ways that competent junior system admins 20 years ago knew how to do correctly and how to not fuck up. Juniors.
Show threadR.L. Dane    🍵 Oct 29

@rootwyrm @cR0w

2000s: Relying on a Single Point of Failure service: will get you laughed at, if not fired
2020s: Relying on a SPOF service: Standard Operating Procedure

I.T. is just so forking dumb right now. :/

Show threadSylvie Oct 29
@rl_dane @rootwyrm @cR0w Management: ‘Instructions unclear. Reallocate more servers and money to AI?’
Show threadR.L. Dane    🍵 Oct 29

@sylvie @rootwyrm @cR0w

I dunno, lemme fire up ChatGPT and ask...

NOT

Show threadLROct 30
@rootwyrm @cR0w well that was under the influence of gen x. and gen x is leaving. it's up to (elder) millennials to manage this shit show now. and aren't we doing a great job?
Show threadEpic NullOct 29

@cR0w Honestly... this probably ties back to ownership and accountability in some really weird ways.

If the computer system was someone's domain under which they had control and accountability, would they feel antsy enough to enforce a switchover? Or to start a switchover project?

Show threadVissOct 29
@cR0w the ex-nike sales bro who is now the ciso says to do it though!
Show threadschrotthaufenOct 29
@cR0w @Viss Every time something like this happens, and upper management asks how I plan to deal with things like this in the future, I reply “By telling you what I’ve told you with every could / SaaS outage we’ve experienced so far: Nothing. Unless you give us time, and money to host everything we need ourselves. This would include migrating away from Atlassian, and Microsoft.” To which they respond without fail: “We’ll just accept the risk then.”
Show threadVissOct 29
@schrotthaufen @cR0w "self hosting is the answer. it will cost less, but it will take more time. thats the tradeoff. either we host it, and shoulder all the work for the fabric and storage and power, and have total control - or .. we dont. pick one."
Show threadschrotthaufenOct 29
@Viss @cR0w I’ll try that wording next time. I’m not hopeful, but it’s worth a shot.
Show threadVissOct 29

@schrotthaufen @cR0w the more one-sentence, plain english you can get, the more it will land. you have to be authoritative and matter-of-fact about it.

"look. you can trust them, or you can trust your staff. if you trust them, youre screwed when they fuck up. if you trust your staff, you have someone whos job is on the line. the person who job is on the line will care more about their work than some random cloud engineer"

Show threadZimmieOct 29

@Viss @schrotthaufen @cR0w I’m a fan of pitching it as quality control. Outsourcing something (including outsourcing your hardware and hypervisors) is saying quality just isn’t that big a deal to you.

There’s a reason Apple started designing their own processors, and Facebook started designing their own network equipment. There’s a reason Netflix runs their CDN nodes on their own hardware. They care about the quality, so they bring it in-house.

Show threadviqOct 29
@bob_zim @Viss @schrotthaufen @cR0w quality is not the only thing. When you have say 5+ digits of just network switches, instead of paying the salaries of designers, manufacturers, marketers and CEOs of the company making them, and having features not quite aligned with what you need, how you do things... It starts making sense to just build them yourself, at fraction of the cost, even though they may not have all the features.
Show threadZimmieOct 30
@viq @Viss @schrotthaufen @cR0w Quality isn’t the only thing, but bringing something in-house generally takes a lot of money up front. The project only starts paying for itself after a few years. And of course, you only see those savings if the project is successful. I’ve found quality control the key point in the past with savings in second place.
Show thread➴➴➴Æ🜔Ɲ.Ƈꭚ⍴𝔥єɼ👩🏻‍💻Oct 29

@cR0w Okay, seriously, there's something I _really_ don't understand.

In the 90s, a startup would just run from a computer under a desk. Colocation would come when you expanded, and you'd rely on DNS.

It was orders of magnitude cheaper than cloud hosting is now.

Why does everyone pretend that you _have to_ use cloud hosting?

Show threadPascal GirardiOct 29
@cR0w Seriously, it’s wild. If any smaller company messed up half as bad, they’d be dropped instantly. But when it’s Microsoft or AWS, everyone just shrugs like “eh, what can you do?” and keeps paying. The lock-in is insane — they know people can’t really leave, so there’s zero incentive to do better.
Show threadwww.bloodoutofstone.comOct 29
@cR0w so true, it has made my last few weeks a lot more difficult to do tasks and I have little to know choice on the backend of other people systems. At least it will get worse before it gets better and my prehistoric tough book games will be unaffected when the internet has a snow day
Show threadMichael StancliftOct 29
@cR0w Meanwhile if it was their internal IT infrastructure heads would be rolling.
Show threadUrzlOct 29

@cR0w The most confusing thing lately is hearing at work how we're one of Microsoft's bigger AI customers like it was something to brag about.

Why would you be proud of being scammed harder than others?

Show threadjesterchen42Oct 30
@cR0w Reminds me of the crowdstrike outage...
Show threadjackOct 30
@cR0w one of my colleagues asked my team "what can you do?" at about 16:15 this afternoon and, lol, lmao
Show threadDistanteOct 31
@cR0w We can start with small steps and choose from the alternatives that exist https://european-alternatives.eu/
European Alternatives

We help you find European alternatives for digital service and products, like cloud services and SaaS products.

European Alternatives
Show threadgrob (teeth era) 🇺🇦🏳️‍🌈🏳️‍⚧️Nov 3
@cR0w I guess this is not unique to Amazon and Microsoft. In my anecdotal experience all 'top of the class' companies (i.e. big market cap in their segment) are a bit of a sausage factory. Not excusing MS and AWS btw, but accusing the others too. Being infrastructure is a compounding factor for the former though.