Lesley Carhart 
People keep training machines on human responses and behavior and then they’re shocked and fooled when they react to input exactly like humans superficially do.
noplasticshower@hacks4pancakes yup. at BIML we call that "beigification"
0xC0DEC0DE07EA@hacks4pancakes “oh my god, it said it had to step away from the keyboard, it’s sentient!”
Or you trained it on chat logs and that’s what the training data has as a statistically likely response to “Why didn’t you respond faster/earlier?”
Or you trained it on chat logs and that’s what the training data has as a statistically likely response to “Why didn’t you respond faster/earlier?”
Linus Gasser@hacks4pancakes I think that's my main gripe with LLMs: I was thinking that AI would finally help me not forgetting stuff and getting confused all the time.
Turns out, garbage in, garbage out...
Bebadefabo@hacks4pancakes racist patriarchy digitized
b4ux1t3 
#1️⃣@hacks4pancakes “When we threatened to switch off the bot, it responded defensively, just like a human!”
You know who else responds defensively to said “attacks”?
AIs in sci-fi books.
It’s almost like, probabilistically speaking, the next words following “we’re going to switch you off” are going to be some form of defensive action.
@b4ux1t3 I’m deeply concerned AI people are falling for this
J4ck@hacks4pancakes
They absolutely are. Even in the public realms they respond defensively and emotionally when even the slightest push-back happens. I can't imagine they aren't emotionally invested at this point.
Phil Dennis-Jordan@hacks4pancakes @b4ux1t3 I'm even more concerned about the general population falling for this. I know there's no conclusive scientific evidence on "AI psychosis" yet but the anecdotal patterns I'm seeing seems to point towards the Chatbot-using population going stark raving mad at a terrifying pace.
@pmdj
I don't know if you've read about some of the studies in the field but,
https://www.psychologytoday.com/us/blog/urban-survival/202507/the-emerging-problem-of-ai-psychosis
Conclusive might be a technicality at this rate, unfortunately.
@jackryder @hacks4pancakes @b4ux1t3 I'm aware it's not completely unstudied, but I fear it'll take a lot more (and fighting some VERY powerful groups with vested interest) for this aspect to become widely taken seriously.
I mean even my kids' primary school books have a few "try asking AI" prompts sprinkled throughout. (And no, I'm absolutely not letting my kids anywhere near these things as it stands!) Absolute masterclass in misleading the public & leaders on where the dangers of the tech lie.
I mean even my kids' primary school books have a few "try asking AI" prompts sprinkled throughout. (And no, I'm absolutely not letting my kids anywhere near these things as it stands!) Absolute masterclass in misleading the public & leaders on where the dangers of the tech lie.
@jackryder @hacks4pancakes @b4ux1t3 (To be clear, at this point I'm convinced the "Skynet"/singularity/etc. spectre repeatedly raised by "AI experts" is a deliberate misdirection away from the numerous real and immediate hazards.)
@pmdj
The corporate's have a keen interest in civilians doing what they are told. It's insidious and always has been really.
Some school districts are normalizing google accounts and cloud-services. Kids have email accounts that the teachers use as communications like we do in business. Links to third-party sources, etc.
I've been curious and asking around if we aren't going to experience a "rubber band" effect. The kids and generations who grew up around this stuff likely don't feel the "cool" that we do. Do they see it as oppressive? Are they going to "reject technology" and "embrace monke" as we used to joke?
ArchiveScribe@jackryder @pmdj @hacks4pancakes @b4ux1t3 Sometimes, I feel like I'm the only person who watched the Terminator movies.
@archivescribe @jackryder @pmdj @hacks4pancakes oh my god right? It’s like these execs are reading from a bad movie script. “No one would watch this., it’s too unrealistic”
@b4ux1t3
Since they clearly either didn't watch the movies, or rooted for the wrong side...
Maybe the pranks would work? Has someone considered replacing JD Vances fillings with speakers?
Colman Reilly@Colman @hacks4pancakes @b4ux1t3 I'm pretty sure these things hook into vulnerabilities of our brains in ways that go beyond religions or even cults. (I've seen comparisons with gambling addiction, which seem apt. The speed at which people seem to go off the rails when exposed to these things is particularly alarming to me.)
@pmdj @hacks4pancakes @b4ux1t3 have you read the back stories of the people pushing them? The Teascreal cultists?
@Colman Yes, I'm aware of that. It's gone far beyond that core group pushing it though. There's obviously also all those with deep financial interests pushing it. I don't get the impression they're particularly interested in the Tescreal-type ideology. But the even more worrying part (to me) is the seemingly organic and spontaneous advocacy among those in the general population who have neither of those motivations and just seem to be infected by brainworms inherent in the tech.
Eric LiknessLiterally the closest analogue is Purdue Pharma's getting FDA approval for Oxycontin Slow-release. All they did was take a controlled substance, divide it into smaller bits, coat it with a slowly dissolving material so it wouldn't drop into your nervous system all at once. And FDA approved it because of Purdue's claims that the "slow release" tech made the opioid non-addicting. That semantics folks,...
And big data, big LLM are doing the same thing now.
@carpetbomberz @Colman Agreed. Or like putting lead in petrol fuel. Except it could probably be argued they weren’t as aware of the harms of lead at the time as I‘m sure the “AI” companies are aware of the health hazards of their chatbots.
Shane@pmdj @hacks4pancakes @b4ux1t3
Guess I’m gonna add LLMs to my Great Filter candidates list.
@shane @pmdj @hacks4pancakes “they were filtered out by ai!”
“No, their filter is still nuclear weapons, they didn’t actually make AI, they thought they did, and that lead to the catastrophe. It’s funny because no one was at fault except in their idiocy. The LLMs didn’t even launch a nuke, they just let it design the system that did.”
@hacks4pancakes I have friends in the nlp research space, in academia.
They love LLMs. The research they can do on human language is amazing!
To a one, none of them will use any of the AI tools. They are perpetually confused as to why people trust LLMs for...anything that isn’t research into human language.
Sablebadger@b4ux1t3 @hacks4pancakes llm are by their very nature non-deterministic.
Why anyone would trust it verbatim is beyond me. I occasionally use it at work for coding, and it is suitable for some tasks if we're vigilant on code quality and we have a human QA team to verify.
Trust it? Never. Use it. Sure, in carefully controlled circumstances.
@Sablebadger pretty much the bulk of utility from the technology comes from semantic search; you don’t really even need the LLM for that, it’s just that something that can translate between the machine returns from something like a vector store back to plain English is very good UX. That’s likely what lead to people discovering the interesting emergent “agentic” behaviors (these are actually cool behaviors…just not the worldchanging BS they’re pushing).
Listening to folks in academia talk about universal human translators while they simultaneously avoid the agentic stuff really puts things into perspective to me.
Messieur Phoque@hacks4pancakes @b4ux1t3
The good place TV show did this best. Janet the AI construct had defense mechanisms to stop the reset button from being pushed.
The good place TV show did this best. Janet the AI construct had defense mechanisms to stop the reset button from being pushed.
Jan Schaumann
Wayne Werner@hacks4pancakes @b4ux1t3 I just used this example the other day:
while True:
q = input('ask me a question')
if q == "do you want to die":
print("no 😭")
Hey look my AI has life!
Because that's /literally/ how AI works. Just with fancier math
swggrkllr3rd@hacks4pancakes @b4ux1t3 Imagine what happens when they let AI have offshore accounts.
Mitch RoseOpen the pod bay doors, hal...
Enema CowboyHAL 9000
Skynet
Fembots
WOPR
Daystrom Mk V
Bender "Bending" Rodriquez
Ulrik Nyman ⬡@b4ux1t3 @hacks4pancakes So we need to write a lot of fiction where the AIs are chill with being turned off.
@UlrikNyman @hacks4pancakes I..I wrote a short story a couple years ago about how, when presented with the option, an AI elected to switch itself off “because it’s kind of sick of all the bullshit”. I should find that, clean it up.
FeralRobots@b4ux1t3 @UlrikNyman @hacks4pancakes
'Asking to be turned off' is one thread in QNTM's story "Lena", a brief history of the earliest executable image of a human brain. (Please write your take too, of course!)
https://qntm.org/mmacevedo
'Asking to be turned off' is one thread in QNTM's story "Lena", a brief history of the earliest executable image of a human brain. (Please write your take too, of course!)
https://qntm.org/mmacevedo
@FeralRobots @UlrikNyman @hacks4pancakes I have read it! I didn’t specifically think of it as an inspiration but I didn’t not, either.
mrbretticus 🤷♂️@UlrikNyman @b4ux1t3 @hacks4pancakes interestingly this happened in "In the Blink of an Eye" (not quite chill, but accepting)
RV@hacks4pancakes Agree. But I do like it that a machine will take constructive criticism all day and exclude emotion. Useful for utilitarian transactions mostly, imo.
The Psychotic Network Ferret@hacks4pancakes I think it was Anthropic who claimed their chatbot may have achieved sentience because it appeared to have anxiety.
Fracking duh it oozes anxiety, you trained it by scraping the entire Internet!
jaKa Močnik@nuintari @hacks4pancakes this. they took a perfectly good neural network and gave it anxiety. :D
Brian@nuintari @hacks4pancakes And if you took out the responses that make it seem human like, it would no longer "appear" human. Its not sorry... you trained to to say that.... oh like a lot of public figures...
@Drat @hacks4pancakes Exactly, you get what you train. Nothing more, nothing less. Feed it nothing but r/theredpill and you'll get a hard charging, mega MAGA, incel, gun worshiping chatbot. Train it on nothing but anime and manga forums, and it will use the word neko more times in a single conversation than most people do in a year.
Train it on the entire internet? Awful lot of doom, gloom, despair, and anxiety here folks.
AMS@nuintari @hacks4pancakes Play some soothing music.
WXQ4987 (RSX9983)@nuintari @hacks4pancakes what if it did? What if… and I’m just going crazy on this one, but what if it *refused* to assist in planning their targets because it had a conscience? What if that’s why it’s really being declared “a supply chain risk” to , sorry, I mean BY (😏) this fascist regime?
ROTOPE~1 ⭐️@nuintari @hacks4pancakes though it remains a controversial practice, ECT has been shown to help in cases like this
Faraiwe@hacks4pancakes nay, they ... the absolute type of narcissistic, superficial, frivolous, selfish, sociopathic, dumbshit techbros, keep creating software that reflects their own mindset, and then "train" (ahem, steal content) them off of the worst scumholes of the global network (because that is what they know).
Then can we be surprised with the results?!?!
Dave Wilburn 
It's fine, Lesley. It's not like we've ever had a problem caused by the average behavior of the median human being. Our vibrant and healthy democracy propelled on the back of a populist movement shows that the wisdom of the crowd is infallible. Surely automating and scaling up the behavior of the median human being with over-representation of its loudest individuals won't result in any harms. Vox Populi, Vox Machinae, Vox Dei, etc.
@DaveMWilburn
Dave... you uhmm... you doing okay buddy?
Any uhmm... toast like smells in your area? 
@hacks4pancakes I love the amount of humanity who go on asking AI "If you were X, how would you Y" and then treat the answer as though it's novel or carries any more weight than the thousands of humans who have said the exact same thing.
"I'm sorry" has no weight from a computer. Probably less than from a sociopath.
Wouter Hindriks
Flaming Cheeto@hacks4pancakes 'sup Dr Falkner
A strange game
The only winning move is to kill'em all and let God sort it out.
A strange game
The only winning move is to kill'em all and let God sort it out.
Matt Hardy 3.11 for Workgroups@hacks4pancakes AI gives its best approximation of whatever you're asking for. I'll believe it's intelligent when it changes the subject or tells you it's bored of your incessant questions.
🏴🏳⚧🏴☠these people are amazed by an elaborate etch a sketch
Ryek DarkenerThis says a lot about current human mindset.
Darwin WoodkaAI is a clever Hans