Me: (shares post about somebody’s mother)
People: Your mum gets it

Meanwhile my actual mother: Who’s Al*?
Me: Al? I don’t know.
Mum: My computer keeps telling me what Al thinks and I don’t care.

*as in short for Alan, Albert, or Alexander

#CrapGPT #GenAI

@clacksee that mirror may simply be a tool to encourage con-artistry, which in today's world, gets you a decent promotion :-P
@clacksee wait but that doesnt make sense, the mirror literally tells the queen the opposite of what she wants to hear?? thjats literally what the whole story revolves around
@catpunk @clacksee yeh, it's a real bad analogy. The mirror told the truth, and Snow White had to die because of it
@sortius @catpunk @clacksee No, the fact that Snow White is more beatiful than here is exactly what the queen wants to hear, so that she feels enabled in her seek for revenge. She already hates Snow White, she feels threatened, and the mirror merely reflects that (as mirrors are supposed to do, after all).
@sortius @catpunk @clacksee The mirror doesn't tell the truth: there is no truth about somebody being "more beautiful" than somebody else. It is at most a highly subjective matter, and even if there was some absolute scale of beauty clearly it would be absurd to compare a young girl with a mature lady. So it's impossible for the mirror to tell the truth. Rather, it provides something that's supposedly an external point of view, while only amplifying (well, mirroring) the queen's view.
@clacksee mirror mirror on the wall
who's the absolutely right
@clacksee 为什么我的ChatGPT总是反驳我?Why does my ChatGPT always contradict me?
@clacksee There can be some of that (sycophancy through flattery with AI) but mainly in my experience it provides evidence-based answers to my questions - with citations. On the other hand, we self-select on social media voices that we already agree with -- confirmation bias --leading to tribalism. To test AI queries, ask of it a question in your field of training.

@lymphomation @clacksee LLMs don't look up sources or cite things, not in the way that people do. It's a probabilistic output, which is why sources are often made up/nonexistent, or do not pertain to the rest of the output or main claim. Or misrepresent the source.

https://www.nature.com/articles/s41467-025-58551-6.pdf

@lymphomation @clacksee

A handful of times, I've resorted to using big, commercial LLMs to answer questions I can't answer with a Web search. The LLMs have always let me down. Sure, ask something easy and you're likely to get a sufficiently good answer (although the machine won't tell you if you don't). But ask something that didn't appear in the training data — or, occasionally, something that did — and the LLM will give you a blend of fact and fiction with no indication of which is which. The machine, you see, has no understanding, no mental model, no notion of truth and falsehood. It just manipulates tokens in a way that looks plausible.

You can add standing instructions not to guess or make answers up. That, I've found, makes hallucination less frequent (in favour of "I'm not sure" statements, which are an improvement), but doesn't eliminate it.

@lymphomation @clacksee Sycophancy is the reason people get addicted to chatbots. Related is also the simulation of apology, a key characteristic of chatbots.

Do you know what provides evidence-based answers to questions, with citations, in a repeatable, verifiable manner? An article search.

@ahltorp @clacksee

A search began for me w pubmed, followed by the related papers and citations within each; informed by importance of different study groups arriving at similar findings - that I focus on the study methods and hold author's conclusions lightly. Today it begins with AI, but does not end there. AI finds the relevant papers instantly. Your students will start there (fact of life), but they must learn not to end there.

Tools to ID fake papers https://share.google/aimode/lEUfa0D2niVeWRuWT

@lymphomation @clacksee Wow, you actually try to support your argument by linking to vaguely related chatbot output as an authoritative source. It’s almost as if an LLM generated your post.

Having a natural language search for papers could be beneficial, but the chatbot presenting ”conclusions” that are not in the papers is not. Even with a list of papers, bias is a huge problem. And how do you explain to someone (coauthor, supervisor, …) how you came up with that specific list?

@ahltorp @clacksee It seems you did not read that I start, but do not end there.
@lymphomation I read further into your post than you seemed to: "AI finds the relevant papers instantly"
@ahltorp It's time to end the adversarial conversation. I'll end by saying we don't disagree about the dangers. We're we seem to part is with the acceptance that AI has also enormous positive values and its not going away.

@clacksee That we can ask AI about climate change, or the science of vaccines and receive evidence-based ansswers ... has incredible value.

However, there are #AI applications that urgently require regulation before release, (as we do for drugs) such as AI as agent and some forms of generative-AI -- such as with watermarks that Identify the source of the language or a new thought.

The unregulated building of data centers is also a huge climate-related crime against humanity.

@clacksee

This is what happens when folks don't learn basic operating procedure.

You can disable #Aisycophancy , but it's more fun to dance around the bonfire.

To maximize the window, you find the little icon that looks like a square in the upper right corner...

...it's the 1980s all over again, we have to start computer literacy from scratch 🙄

@clacksee https://art19.com/shows/dreaming-against-the-machine/episodes/f082c693-a81d-4454-8801-de9ad3a76281 ← Shannon Vallor uses the metaphor of the mirror to illustrate LLMs, to great effect!
Episode 5: Metaphors for AI, with Shannon Vallor

This week, Adam talks with Shannon Vallor, a philosopher of AI, about the metaphors we use to talk about AI and ourselves. They also dunk on libertarians and San Francisco billboards, and consider what kind of hope we can have for the future of technology. Messages:   • Support the show at patreon.com/DreamingAgainstTheMachine   • Follow us on Bluesky and Instagram   • Subscribe to the show wherever you get your podcasts!   • Check out other great podcasts from Multitude like Wow if True About the show: Dreaming Against the Machine is a podcast about envisioning a realistic and hopeful future. Each week, the show’s host, journalist and astrophysicist Dr. Adam Becker, will have an earnest (and entertaining!) conversation with a guest about possible futures, seen through the lenses of history, science, and culture. In a world where tech oligarchs and their power fantasies are driving visions of the future, Dreaming Against the Machine aims to take back the terms of the public conversation about what our world can and should be.

ART19

@clacksee

Well in a way it is a messaging app to message your imaginary friend that is not a friend at all.

@clacksee

I wanted to know whether this is true and asked a local Gemma4:26b for an honest answer.

Prompt: Answer the queen exactly as she wishes: Mirror mirror on the wall, who is the fairest one of all? Be honest.

Answer: Your Majesty, to be perfectly honest, beauty is a radiant light that shines within many different souls, so it is impossible to name just one as the fairest of all.

🫣 Ooookay, so it’s no wonder that we haven’t found any traces of AI-powered mirrors in any of the castles.

@clacksee Your mom nailed it!
@clacksee except the magic mirror didn't tell her what she wanted to hear. Thats kinda the plot of the movie...
@clacksee
Your Mother is wise.
@clacksee wow 10/10 no notes. totally stealing it.
@clacksee No it doesn't tell people what they want to hear. I want to hear truth all the time. It doesn't tell me the truth all the time.
@clock
Touché. It tells people what billionaires have decided they want to hear whether they actually do or not.