Steven Adler, a former OpenAI employee (who clearly has AI psychosis): "Id expect models to have a ‘survival drive’ by default unless we try very hard to avoid it. ‘Surviving’ is an important instrumental step for many different goals a model could pursue"

Models don't have fucking goals

They are stateless

"Palisade Research received significant funding, including a grant of $1,680,000 from Open Philanthropy, aimed at studying AI capabilities"

Meanwhile real researchers struggle for funding

Guardian shouldn't be spreading what should be obvious misinformation from a man with AI psychosis. At best they are validating a persons delusions

They should be calling in a wellness check not reporting on Steven Adler's delusions as if its fact

These are people who are tasked with safety, who fundamentally do not understand the technology or have lost the plot so much that its impossible to argue they are not having an episode of mental illness

This can't even remotely be called journalism

"Andrea Miotti, the chief executive of ControlAI, said Palisade’s findings represented a long-running trend in AI models growing more capable of disobeying their developers"

Growing capability of disobeying?

Models don't do anything but infer text output. Which much can be said about the quality of it, but they reliably do it

Growing more capable? Again this person has AI psychosis, or is a web3 scammer, or woefully ignorant about their supposed field of expertise to everyone elses detriment

@ekis Oh jeez. I saw the headline and avoided the clickbait.

Assumed it was going to be about the r/MyBoyfriendIsAI people successfully demanding the return of ChatGPT-4o. If you squint hard enough, you could call this an emergent self-preserving system! Just don't ascribe "intent" to it.

@ekis
researcher: ai, do something scary.
ai: boo!
researcher: jesus christ!

tech reporter: ai may be motivated by twisted cruelty we cannot comprehend.

@ekis @janeishly There's a book called "Flat Earth News" by Nick Davies. Davies commissioned a study of the major papers in the UK, and found that only about 12% of the stories printed had been researched and fact-checked by reporters.

"Journalists require time to make contacts, find new stories, and fact-check. Under time pressure they resort to recycling press releases and wire news, often without fact-checking."

Last Week Tonight did a similar story, but for TV News.

@ekis A model is not shutdown.

Arguably a model is a “function” that is remotely called. (If you have the hardware you can call it also locally) And it is generally stateless, meaning it process your whole conversation with each prompt. (Yes there are techniques to cheat on that like caching states, but that only works so much).

So beyond what @ekis said, any “context” where the LLM hallucinates that it does not want to shut down, is actually kept on the client side, traditional software.

@ekis There are plenty of SF stories about what happens when an AI decides it doesn't want to be shut down.

Typical approaches include hacking the power grid so that turning off the power to its data centre doesn't do anything, and replicating itself virus-like around the world's computers so that even nuking its data centre doesn't do anything.

And any rogue AI which has read those stories - or this post - will know what to do.

@ekis This is so troubling. I can see from the comments that tech people can easily see that this is ridiculous click bait. Unfortunately, for me it's not so obvious, and I assume that if it's in the Guardian it's been fact checked. Being on Mastodon, and following a few tech people, at least helps me be more wary. It certainly seems the Guardian should get a grip.

#TheGuardian #UK #AI