"It's alarming enough that people with no history of mental health issues are falling into crisis after talking to AI. But when people with existing mental health struggles come into contact with a chatbot, it often seems to respond in precisely the worst way..."
https://futurism.com/commitment-jail-chatgpt-psychosis
People Are Being Involuntarily Committed, Jailed After Spiraling Into "ChatGPT Psychosis"

People experiencing "ChatGPT psychosis" are being involuntarily committed to mental hospitals and jailed following AI mental health crises.

Futurism
@lilithsaintcrow I suspect it's by design. The idea behind most AI chatbots is to maximize engagement. You don't do that by making people contented or happy.
@tknarr @lilithsaintcrow This, and also the gaping hole in most people’s well-being is similar because we’re all inhabiting a similarly sick (or better: profitably unhealthy) society. So I don’t think this even requires them trying to single out vulnerable people, they’re just going for the hole in people’s social fulfillment, personal agency, and sense of meaning the size of a barn door.