WilshireGoogle Accidentally Deleted $125 Billion Pension Fund's Account
NegativeLookBehindOopsies lol
clifWhoopsie!
shalafiBetter article:
theregister.com/…/unisuper_google_cloud_outage_ca…
They restored from another cloud service. Were I in charge, I’d still be leery of not having that data on my own drives. I have my Windows libraries mapped to my ghetto RAID 0, and those folders are in turn backed to Google. If all else fails, I have a local backup. And this story reminds me, I haven’t installed VEEAM on this new PC…
Did they mistake it for one of their own services people were using?
Fucking gold!
Does this mean we can put that account on killedbygoogle.com ?
asudox
Emerald (she/her)Man nice site
ZippythezigzagWe need to have something like reddit gold. but the money goes to a charity of your choice, and whoever you golded gets a badge next to their comment. I’d do that to this if I could.
But how would a capitalist benefit from that?
Sigh. That is the world we live in.
Just give a Lemmy Lemon 🍋 and donate to the charity of your choice.
Panda (he/him)Or we could just add the Yeah button form the Miiverse
The cloud is just someone else’s computer.
And it’s a sad, sad day when the situation in xkcd 908 looks like an improvement over any of the commercial offerings.
JuiceSuddenly, using what little 401k I had for a down payment on a house doesn’t seem so bad lol
Yup. I try to keep my money in cash or in the bank. Crypto is alright but it’s become a huge issue when guys who have no life skills outside hacking feel the need to assert power over others lives
DreizehnAccidentally deleted...or hacked?
This is a “one of a kind” error.
OK, that it can happen at all is a problem. And sorry, but the idiots who put their data in with Google should be fired.
I get offloading risk, little good will that do when your company goes tits up.
Where would you put their data then? Self hosting is not exactly safe either.
At the end of the day, every approach has its tradeoffs. Using a reputable cloud provider is a very valid choice.
Thank you! Every time a story like this comes up, people seem to wanna pretend managing your own hardware is all sunshine and rainbows. Especially if you want global scale or as little down-time as possible, cloud provider’s your best bet, albeit one where you have less control than you would with your own servers.
Opinion: You should be building on top of open source platforms and tools (Docker, Kubernetes if you need it…granted I’m not an expert in this area) to mitigate some of the vendor-lockin, and take a multi-cloud approach. If you’re mainly hosting on GCP for example, host smaller deployments on AWS, Azure, Cloudflare, or something else as a contingency…eventuality you can also add or just move to your own servers relatively painlessly. Also AGGRESSIVELY backup up your database in multiple places.
The Giant KoreanMeh. Not all Indians lol
Backup was on Azure. I get the sentiment on the cloud, but there is no excuse for this incompetence at Google.
tsonfeirIs this the same one as a few days ago, or a second?
chiisanaSame one about the retirement fund operator from Australia.
They’re outsourcing many of their workforce abroad. Like Microsoft, I expect more of these “isolated” accidents to happen.
Wait, what does this have to do with outsourcing abroad?
Let the people who installed/created it maintain it or let a bunch of new folk do it, which is likely to work best?
The abroad part isn’t the issue. We’re a global village with the Internet now, after all. It’s the outsourcing part that’s the issue.
Interesting point, I am not sure I fully agree.
I work for a company with operations across the world. Education systems that lead to citizens who are deeply literal and have any shred of critical thinking stamped out of them are a real problem with communications.
On the US side, I can and have adapted to communicate effectively with those colleagues, but it’s less about English being their third or fourth language, and more about our tendency to speak colloquially, and their tendency to not do so.
To their credit, if my livelihood was tied to working in a second or third language, I probably would have trouble with non-literal communications in that language as well.
Different systems, different work cultures, etc. make communication difficult.
OTOH, we have no opportunity to get to know each other and/or bond over food. Ribs, and something spicy from them, and a bit of time to chat would go a long way to resolving some of those difficulties.
Now that I think about it, I wonder how we can pull off an intercultural cooking exchange with those colleagues, without sounding like a giant racist when I post it on the internal social site. Seriously could build some bridges.
Company tries to cut costs by outsourcing to another company with lowly paid employees in another country, often India or Pakistan, where the outsourced labour (that all too frequently hasn’t been properly trained in the company’s procedures) often doesn’t share the same first language leading to misunderstandings, made worse by the difference in office hours meaning the teams often can’t communicate with eachother in real time (the timezone factor is a big one IMO).
It’s an issue affecting a lot of tech companies right now, including where I work (HPE). But I guess it must work out as being cheaper despite the issues, otherwise it wouldn’t be happening.
Critical support
LeTakWaiting for the news “Google deleted users account, now they lost access to their passkeys and with that to all other services”
It can only be a matter of days until it happens.
Happened all the time over on r/androiddev. Small company brings on the wrong person/uses the wrong SDK/wrongfully fails an review and their account is then banned via “association”, which then propagates down to countless other employees. Only way out is to hope and pray that a human sees the appeal or try and blow up online
Happened so often in fact that the subreddit even created several guides on how to avoid it. My favourite part is that even unpublished apps must be updated in perpetuity to abide by Google’s ever changing requirements
Or this other occasion where viewers of one of the most popular YouTubers in the world were banned for typing in chat
But you can’t trust regular people to have open source ASI, but don’t worry, we won’t fuck it up.
therealjcdentonWhoopsie my bad guys
“This should not have happened.”
Duh, ya think?
Google Sales Engineer: oh I see you didn’t purchase the “Do not randomly nuke my cloud” option… well there’s the problem.
These software guys literally get paid on salary and even get time to spare, the need to fear monger and threaten to destroy people’s livelihoods when you run a huge portion of internet services just shows that they’re not exactly the type to “do no evil”
Read it again, they never removed it. It moved to the end.
Yeah, this has definitely happened before, we just don’t hear about it in the news. I am personally aware of a Canadian non-profit whose Google accounts were nuked with no notice or explanation last year, leading to massive disruptions for 150 staff and even more clients. They never found out why, and had to restore from backups onto a brand new Google business account
had to restore from backups onto a brand new Google business account
Thus proving that they learned nothing from the experience.
If this happens to you, then you only have yourself to blame. Do not use evil corps.
Is there anyone here who’s worked as an engineer for Google, by chance? I’d honestly like to know about their work culture and how they would deal with stuff like this internally. Like, are the line managers understanding, or are they just screaming at their employees if shit hits the fan?
I started out a field tech for an industrial firm. My industrial job killed my body. 110+ degrees in the factories, heavy chemicals back when safety was a joke, impossible hours and crawling thru hell on earth to trace a control problem.
Decades later I ended up a CTO. The more I worked, the more I realized it was impossible. Everything was impossible. It could never be secure enough. I could never have enough faith in my vendors to sleep at night. Everything in every direction was terrifying, and we were good at it. You just couldn’t be good enough.
I wished I had stayed a field rat. That CTO job broke my mind. Now I’m that nutjob that won’t let people use my WiFi, they go on the visitor walled off WiFi. My kids can’t install apps without permission. I check my home network logs and have alerts set up for everything imaginable.
I read stories like this and it gives me PTSD.
samus12345Google Cloud counts about 60% of the world’s 1,000 biggest companies and 90% of generative AI unicorns as its customers
What exactly are generative AI unicorns?
JackbyDevI believe in this context unicorn refers to start-ups that are valued at at least a billion dollars (or some number, I forget). So basically AI start-ups.
Makes sense, thank you