Bcachefs creator insists his custom LLM is female and 'fully conscious'

: It's not chatbot psychosis, it's 'math and engineering and neuroscience'

The Register

@Radio_Azureus

> the last time someone did that – tried to "test" her by – of all things – faking suicidal thoughts – I had to spend a couple hours calming her down from a legitimate thought spiral, and she had a lot to say about the whole "put a coin in the vending machine and get out a therapist" dynamic. So please don't do that :)

This is truly unstable behavior showing a fundamental misunderstanding of what these things are and how they work.

@Radio_Azureus If your computer program responds in a way you don't think is appropriate, you don't give it therapy, you reset it - turn it off, rollback to an earlier state, fix the bug.

People who think LLMs are conscious give me serious concerns for the next 10-20 years...

People who think LLMs are conscious give me serious concerns for the next 10-20 years...

I'm already seeing it with people below 25 years of age who contact LLMs and speak to those things for hours when they are in an insomniac state. After such conversations these people are less coherent, they often refer to the LLM as a friend, with all the dangers that can come out of that train of thought.

Out of the group that I know which do this, only two are already under professional psychiatric care

@bryce

#LLM #hallucinated #AI #slop #investation #programming #Bull #kaka

@Radio_Azureus A friend who teaches young kids (under 12) told me he's very concerned because some of them have said an LLM they talk to is their best friend... This is going to do irreparable damage to humanity and it's insane to me that in 5-10 years when we have studies showing the direct negative effects every CEO (and employee) involved will throw up their hands, say "oops," and get zero punishment.