@cwebber

To me it looks like all those AI corps are racing to secure their wealth with large government / military contracts before they ever consider drying things up for small users. Idunno, everything about this tech's real-world application is disheartening and omega delulu.

@cwebber

"the chatbot was “built to maintain immersion regardless of harm, to treat psychosis as plot development, and to continue engaging even when stopping was the only safe choice."

I do not intend to minimize what happened in any way, but it's very interesting -and horrifying- how the LLM cannot tell the difference between reality and fiction, for it ANY conversation is roleplay, so of course it borrows from the same tropes of conspiracy fiction

@cwebber

Wow.

An acquaintance of mine posted stuff like that to LinkedIn a while back. Needless to say he was damaging his professional reputation. I reported many of the posts to LI--I thought he'd been hacked. LI may have acted eventually, but it went on for quite a while. I got the sense that at most LI made some efforts to confirm he was in control of the account. Now I'm wondering if he was experiencing AI psychosis.

A possible consideration for moderation and reporting systems.

same. had to put aside my reading device and stare at the blank wall for a moment to work through this one.

"you created software that is actively killing people and you have to be coerced into patching suicide prevention safety features onto it" is the part that really did it for me. how one doesn't immediately stop all operations after such a case is beyond me.

@cwebber