You don’t need to understand the math behind large language models in order to get that they are not minds.

The next time you meet someone who believes ChatGPT knows anything, experiences perception, has motivations, or forms opinions, show them this video.

Link to the original:

https://www.tiktok.com/t/ZTM6ytyLR/

TikTok - Make Your Day

The answer to the question “Why can’t ChatGPT be my therapist?” is another question:

Who do you think you’re talking to when you talk to ChatGPT?

AI can’t be your therapist because you can’t be your own therapist.

https://www.tiktok.com/t/ZTM6ytyLR/

TikTok - Make Your Day

@maxleibman The Dr. Sbaitso program could also redirect your questions back to you an infinite number of times. The main difference seems to be that the text-to-speech patterns have gotten better.

@brandonlivesin @maxleibman

I remember Dr. Sbaitso! That was, of course, just Creative Labs' version of the classic ELIZA therapist program, used to show off their sound cards' speech synthesis capabilities. ;)

ELIZA - Wikipedia

@brandonlivesin @maxleibman
"HELLO TROLAND, MY NAME IS DOCTOR SBAITSO.

I AM HERE TO HELP YOU.
SAY WHATEVER IS IN YOUR MIND FREELY,
OUR CONVERSATION WILL BE KEPT IN STRICT CONFIDENCE.
MEMORY CONTENTS WILL BE WIPED OFF AFTER YOU LEAVE,

SO, TELL ME ABOUT YOUR PROBLEMS."

Can you tell I played with this alot as a child?

@maxleibman

AI ate whole of the internet.
Of course it "knows things"

Just like with web search, especially in its early days, you have to know how to get at that information.

@n_dimension Exactly right that you put “knows things” in quotes, though. It knows things the same way a dictionary knows things. I didn’t say there’s no information in there, but that isn’t the same as knowing.

@maxleibman

Not trying to start an angry yell match.

Max Tegmark had some real insightful research how LLMs "understand" things by forming platonic "engrams" that can be visually interrogated.

Thats how you know LLM "understands" an item vs raw multidimensional vector data structure.

@n_dimension @maxleibman my dude, you quote *yourself* in your bio, no one's going to take you seriously.

@xale @maxleibman

"Being taken seriously"
Was never one of my goals.
Checkmate 😁

@maxleibman @n_dimension with the difference that the things in a dictionary are usually correct and not some random made up bullshit for some of the words

@eruwero @maxleibman

Probabilistic =\= Random

@n_dimension @maxleibman it's still random so I don't really get your point.
@eruwero @maxleibman @n_dimension also, you can use a dictionary to find out if a word exists. I've never had an LLM tell me something doesn't exist - it just makes up something plausible sounding

@vt52 @eruwero @maxleibman

You're not asking the right questions.
My AI says "No" all the time...
... This is from this morning.
#imsosmart

But more seriously, I maintain using AI effectively is A LEARNED SKILL.

@n_dimension @eruwero @maxleibman won't disagree that it's an acquired skill. perhaps I'm just working in problem domains that lack adequate training
@n_dimension @vt52 @maxleibman that's a great marketing strategy. If it doesn't work, you're using it wrong. They claim this stuff has "PhD level intelligence". If you need to learn how to talk to a PhD so they can answer basic questions for you, and they might still just make stuff up, then that PhD is stupid and pretty much useless.

@eruwero @vt52 @maxleibman

Every time you launch an #LLM session, it fires up "OS prompts"
Like "Don't help make meth"...
...what's a few more prompts to make it more effective tool?

It's a little bit like firing up a Linux console and saying "Whoa, I now have to issue commands to make it work!?"

I note that quite a few AI antagonists seem to have a very optimistic interpretation of the power of these things whilst eschewing them at the same time.

@n_dimension that this is how the make LLMs "safe" is ridiculous btw.

Not really, commands are supposed to do what you tell them to, prompting is more like guessing which tokens will lead to less wrong output, but if you don't know much about the subject you'll never know if it's even remotely correct.

I'm not optimistic about them but I also don't claim that the technology is completely useless. It's stupid, useless, wasteful and dangerous how (most) people use it IMO

@eruwero

One can not ever make #llm safe.
It's a fallacy.

It's mathematically impossible

@vt52 @eruwero @maxleibman @n_dimension

> it just makes up something plausible sounding

exactly this.
It would be much better technology if it would say "I don't know" or "I'm unsure about" when appropiate.

I deeply respect when someone says they don't know. It feels like everything else they said is thay much more trustworthy because that stuff passed the "do I really know it" filter.
Especially impressive when its a person who usually has answers to everything.

@vt52 @eruwero @maxleibman @n_dimension what I describe sound so much different from an LLM.
The guy I am thinking of just knows a lot and tells me where to read it and whips up small demos on his laptop to show what he means. He also has a home lab for trying out network configurations

Hearing "I don't know" from him really makes one trust that everything else he says has a proper foundation.

@saxnot @vt52 @eruwero @maxleibman

Here is three examples of "Don't know" from my chats.

👉"Simatic nonlinear resonance modes" — I said "I'm not immediately certain what you're referring to," "I'm not immediately familiar with what you're referring to as 'Qualia Institute,'" and "I'm not familiar with that specific work" (about Emilsson's 5-MeO-DMT work).

👉"Information Requested on ANZPAA's Diploma of Police Intelligence Practice" — I said "Unfortunately I don't have any specific information about the POL50119 - Diploma of Police Intelligence Practice."

👉When you asked about searching Claude chats, I said "I don't know the full details of how chat history and search functionality work in Claude's interface." Ironic, given I'm now using exactly that feature to find these chats.

"The Emilsson one is particularly notable — that's QRI/Andrés Emilsson's work, which I now know is a long-standing interest of yours. Earlier versions of me clearly didn't have the context (or the memory system) to connect those dots."

If you're not using tech that literally improves from week to week,
You just might reinforce your outdated biases.

#aisycophancy #promptengineering or just, sigh #prompt

@maxleibman When I meet somebody like that, I show myself far away from that person in no time 🤣
Any corporate meeting without an agenda.
@maxleibman Fun and engaging — got it!
@maxleibman ...and many /despite/ the agenda. Though the people I've been in those meetings with can't really be said to have "minds" either...

@maxleibman

Ai can do a lot, but a human still has to at least manage the project.

I would find it much more interesting if each chatgpt instance was assigned a character and one of them had to explicitly start with a thesis.

For example, a discussion between Karl Marx and Adam Smith about which of their theories could best explain the actual world. If necessary, Alfred Müller-Armack could be brought into the discussion as the spiritual father of the social market economy.

@maxleibman

Your video only proves the lack of ability to work without guidance.

Of course, AI still doesn't have a mind, it's just harder to prove. AI is just a complex tool, especially on the basis of current technology.

@sam4000 It’s not my video, to be fair to the creator. But also I didn’t put it forward as proof—as I said elsewhere in the thread, this is an illustrative example, not my whole case.

@maxleibman

Okay, it works well as an example.

Have a nice day.

@maxleibman the longer i listen to this the more the "see face on toast" part of my brain kicks in and i feel like this is *such* a relatable take on a few bad dates i've had

or job interviews 
@maxleibman I have definitely been to this meeting before.

@maxleibman Parry and Eliza did it better…

https://www.rfc-editor.org/rfc/rfc439

RFC 439: PARRY encounters the DOCTOR

@maxleibman That's the same video?
@HugeGameArtGD Yes. Different takes inspired by the same source video.

@maxleibman

Well, it's certainly memorable.

I sure won't forget to keep far away from LLMs.

@maxleibman I was just about to reply to this video with this exact comment lmfaaaaooooo
@maxleibman or with an agenda. Doesn't matter. The result is the same..

@maxleibman

Frustrating that we can't tell if it's ready to dive in and make it as fun and engaging as possible

@TheBreadmonkey @maxleibman I wish I could hear all the memorable stuff it wants to discuss! Sounds fun!

@3janeTA @TheBreadmonkey @maxleibman

Definitely! Ready soon engaging fun sound. For sure could lets go if you want.

@TheBreadmonkey @maxleibman

It was, on the whole, less quirky and entertaining than I was originally led to expect.

@maxleibman Is it just me, or does this sound like every company meeting... ?

@penpencilbrush I almost posted it with the caption "A corporate meeting with no agenda."

Hell, now I think I'll post it again with that, too.

@maxleibman They're both so exciting and fun.

@maxleibman

I can see why the average techbro loves this tech. It sounds like a woman but absolutely does not 'think outside the box'.

@maxleibman The way these chatbots talk makes my skin crawl.

I hate it so much.

@garretble I am not comfortable admitting how much time I've spent with Advanced Voice Mode after hearing about people's use cases and relationships(?), because I was so sure I was missing something.

It still impresses me in a "Wow, it's amazing you can do this at all" way, but there is so much that is off and off-putting about it (at least for me) in practice.

@maxleibman I’ve never really used one of these chatbots, really, so every time I hear them it’s so off-putting.

So…fake sounding even though it’s *close*. This verbal uncanny valley that makes me want to use one of my three genie wishes to just get rid of all of it.

@garretble @maxleibman I thought it was fun and engaging
@gunchleoc
SURE you did, GunChleoc.
@Guillotine_Jones I have never witnessed such an eloquent dialog.