ā€œAI-powered writing tools are increasingly integrated into our e-mails and phones. Now a new study finds biased AI suggestions can sway users’ beliefsā€

ā€œWe told people before, and after, to be careful, that the AI is going to be (or was) biased, and nothing helped,ā€ Naaman said. ā€œTheir attitudes about the issues still shifted.ā€

https://www.scientificamerican.com/article/ai-autocomplete-doesnt-just-change-how-you-write-it-changes-how-you-think/

AI autocomplete doesn’t just change how you write. It changes how you think

AI-powered writing tools are increasingly integrated into our e-mails and phones. Now a new study finds biased AI suggestions can sway users’ beliefs

Scientific American
@gregeganSF it's a good thing all the AI firms aren't run by fascists then! ah, wait, fuck.
@gregeganSF just a constant reminder that brains are really stupid.
@gregeganSF several years ago I got to go to the open source summit in Vancouver, and I attended an AI ethics panel. everything they talked about was an obvious problem, nothing they talked about has ever been addressed by any of the major players in the industry
@gregeganSF Just recently, on a Pixel phone, my keyboard stopped auto capitalising AI. Before I would type ai and it would have AI in the suggestions. Now no matter how many times I type it there's no suggestion. The only reason I can imagine is to make it slightly less easy to kvetch about AI online.
@mspong @gregeganSF it doesn't matter if you say AI or ai. we'll understand you
@gregeganSF i still compose most emails i send in vi
@gregeganSF the future is a dirty place
@mrgtwentythree @gregeganSF If you want to just lie down in the shit and die, go ahead. The rest of us don't see passively accepting fascist conditioning as okay, though.
@gregeganSF only read the toot but can understand what condition this describes

@gregeganSF

Every assist is always turned off. Autofill is no friend to me. If I can't write it, I ain't writing it.

Like, since I was 6.

@GGMcBG @gregeganSF I also refuse to use AI and am really annoyed that it is on the social media and also my handy! 😤
It's very obvious when it tries to sway your opinion too.
Some people are easy to manipulate though
@LoseFriendsandAlienatePeople thinking you're immune to propaganda is a sure fire way of making the propaganda work better
Even before AI, I was very aware of attempts to manipulate me. And you're right, sometimes it works, but rarely. Even when attractive women try to coerce me, I can resist. I'm the most independent minded person I know

@gregeganSF

https://techxplore.com/news/2026-02-llms-violate-boundaries-mental-health.html

"We wanted to rigorously test whether risky behaviors, such as confirming delusional beliefs, assuming clinical authority, or gradually eroding boundaries, can emerge through multi-turn interactions," so Youyou Cheng, first author.

"By demonstrating that such failures do occur and can be systematically elicited, the paper establishes the need for structured safeguards…"

LLMs violate boundaries during mental health dialogues, study finds

Artificial intelligence (AI) agents, particularly those based on large language models (LLMs) like the conversational platform ChatGPT, are now widely used daily by numerous people worldwide. LLMs can generate texts that are highly realistic, to the point that they could be sometimes mistaken for texts written by humans.

Tech Xplore

@rexi
Sam Altman: Why are you showing me this? My housekeeper already stocked up on toilet paper last week!
@gregeganSF

#aiethics meets #capitalism

@gregeganSF
I read a very important advice in a book about three decades ago: never trust something that talks to you when you can't see where it has its brain.

I'd have never thought it applicable to daily life. But - there you go...

Whenever a business offers sth to alleviate my life, my first question always is: what's in it for them?

#noAI #ThinkForYourself

Co-Writing with Opinionated Language Models Affects Users’ Views | Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

ACM Conferences

@gregeganSF All this ā€AI progressā€ flies in the face of everything we know about human consciousness.

We don’t use writing merely to communicate our intents. Writing is a part of ’realising’ what are intents were in the first place.

@gimulnautti @gregeganSF šŸ‘†šŸ¼ Important observation.

@gregeganSF This seems like it might be connected to a previously known phenomenon:
If you lure internet trolls into saying they respect others, it reduces their propensity for abuse.

Because on some level they don't want to disagree with their own words.

Except here the words are those of a bot. But perhaps they are still falling under that umbrella.

@gregeganSF
I've always turned off Auto complete & now auto suggest on my phone, but do use the spellchecker. The Grammar checker is also off as it's pointless on limited size messages.
@gregeganSF These are the Thinking Machines from Dune from 60 years ago.
Not killer robots that hunt down humans to enslave and murder them. But billionaires conditioning lazy and gullible people to make them obedient to their will.
@yora @gregeganSF try to take a slightly more generous view. People aren't lazy and gullible; they're completely stressed, overworked, bamboozled and alienated. This is fertile ground for technofascism.
@fluidlogic @gregeganSF None of that are reasons to use AI.

@gregeganSF Friedrich Nietsche, in 1882: ,,Unser Schreibzeug arbeitet mit an unseren Gedanken.'' (That's roughly ''Our writing tool contributes to the work on our thoughts.'') So he wrote as he had become one of the first users of the newly invented typewriter. The device helped him since he had poor eyesight at the time.

What are autoocmplete and AI helping us with, and what are we poor at? In the end, it's just tools we use for writing, right?

More of a parallel: He didn't buy the typewriter device by himself, but his sister got him one, understanding that it might help him. -- These days, we feel like we're being given the tool, rather than deciding for using it.

Less of a parallel: Nietsche found the device helpful for him.

(https://www.klassik-stiftung.de/en/home/digital/collection-highlights/friedrich-nietzsches-writing-ball/ -- https://archive.org/details/schreibkugel01)

@gregeganSF well I’m delighted to say it doesn’t change my emails because I don’t use it.

@gregeganSF So autocomplete is no longer just guessing the word you are currently typing? What is it doing now, filling in whole sentences? Paragraphs?

I literally have not used autocomplete in maybe a decade. I always immediately turn it off on any device or program I use, before doing anything else, because I found it so annoying.

Fuck AI.

@gregeganSF This is what I have always been concerned with and is why I have never used any auto-complete, well before LLMs arrived.

It doesn't even need to be insidious, we instinctively pick up cues. Every time Microsoft re-enables auto-complete on my Outlook account, I can feel my writing change until I diable it. Maybe my writing could change for the better, but if I do not like how AI writes, why would I want to be influenced by it?

That said I also do not trust these companies at all.

@gregeganSF this is in line with research showing that implicit bias training doesn't actually reduce bias

edit: I'm allergic to not providing sources and broke out in hives until adding these links

-https://www.scientificamerican.com/article/the-problem-with-implicit-bias-training/
- https://www.science.org/doi/10.1126/sciadv.ado5957
- https://www.ncbi.nlm.nih.gov/books/NBK603840/

The Problem with Implicit Bias Training

It’s well motivated, but there’s little evidence that it leads to meaningful changes in behavior

Scientific American
@gregeganSF more information in the article Scientific American based their short article on:
https://www.eurekalert.org/news-releases/1119239
AI assistants can sway writers’ attitudes, even when they’re watching for bias

Artificial intelligence-powered writing tools such as autocomplete suggestions can definitely change the way people express themselves, but can they also change how they think? Cornell Tech researchers think so.

EurekAlert!
@gregeganSF Just wait for the day you can’t turn this off and the day where you are not allowed to write on your own anymore. Just to please those fucking TechBros #ButilerianJihadNow
@gregeganSF
Ugh. I guess it follows, but is not good news. I've been (maybe naively) continuously surprised how folks will allow things like spelling and grammar type checkers (I'm looking at you, Word) decide on wording or spelling choices that are, imo, really stylistic or voice decisions