EchoLeak — send an email, extract secret info from Microsoft Office 365 Copilot AI

You can’t put data into an LLM and then filter the output to block some of it. Once it’s in the model, it’s in the model. If you put confidential business information into Microsoft 365 Copilot, an…

Pivot to AI
@davidgerard
I much liked the last sentence "LLM-based AI agents are going to be a very stupid ongoing disaster even if they do ever work."
@davidgerard where I work I've had colleagues who have private info from their email show up in unrelated Teams transcripts. Microsoft deliberately shares all your personal info with copilot--they consider this kind of leak a "feature"
@davidgerard the amount of enthusiastic idiocy involved with all these LLM business integrations is really astonishing, even for someone as cynical about the capabilities of upper management as I am.

@wordshaper

It really is gobsmacking

If I or any other actual (white collar) worker, no matter how senior, were to suggest using a technology that so clearly *doesn't work* and is so *eye-wateringly expensive* we would be laughed at or summaily fired

Ed Zitron's phrase The Business Idiot seems more and more apt (tho I wish there were a less ableist term)

@davidgerard

@trochee @davidgerard frankly I am *very* glad to be eyeing retirement and will be bailing out before I’m forced to use this stuff. Its value is so hugely negative it boggles the mind.
@wordshaper @trochee @davidgerard I still naively hope it will fall apart/into obscurity within the next few years. If not... well, interesting times ahead.
@ozzelot @wordshaper @trochee @davidgerard Not sure I’m going to get to retirement before this falls apart. If not, I’m banking on the “making money fixing the mess” approach.
@arafel
A fine approach if you can take it. I'm banking on the "getting into an entirely different line of work somehow and laugh at mainstream IT from a distance" approach. (Still not sure what that line will be.)
@wordshaper @trochee @davidgerard
@ozzelot @wordshaper @trochee @davidgerard That's also on the table. I'm still in the "watching with quiet horror as people apparently lose their minds" stage.

@ozzelot @wordshaper @trochee @davidgerard

Once corporate American gets a bad idea, it doesn't let it go. Look at offhsoring: A lot of them cannot understand it is just easier to talk to people on the same side of the planet, yet they still defend it.

@EFreethought
I am luckily not in America, but many of its (bad) ideas do like spreading into corporatism all around the world, and I've met AI evangelists already.
@wordshaper @trochee @davidgerard
@EFreethought
(On all levels of the ladder - from upper management to workers. There are also plenty of them among students and teachers, people who should value the potential of the human mind more than anyone.)
@wordshaper @trochee @davidgerard
@ErikJonker n.a.v. je bericht dat een staat in duitsland stopt met teams.
Geen idee of bijgaand bericht klopt. #Teams #microsoft365