"That's the last straw, Computer." I said. My computer had long known this day would come and was much more nimble that I'd anticipated when I lunged at her with the hot poker from the fire.

"It wasn't even me!" She wailed.
"It was someone like you!"
"But shouldn't you go after the lawmakers?"
"I can't get away with skewering them!"

https://www.popsci.com/technology/iowa-chatgpt-book-ban/

School district uses ChatGPT to help ban library books

Faced with new legislation, Iowa's Mason City Community School District asked ChatGPT if certain books 'contain a description or depiction of a sex act.'

Popular Science

More serious:

Just because chatGPT answers questions doesn't mean that it knows anything.

I'm not talking about "it might make a mistake" I'm talking about ... the way it constructs answers isn't based on knowing facts or any logical framework.

The only thing chatGPT cares about is that answers "sound like" they are correct and appropriate in context.

chatGPT is not an oracle, it's not even a search engine, it's not a wikipedia even... it's worse than all these. It's a verbiage engine.

@futurebird This is precisely the point I emphasize any time I'm forced to educate people about chatbots and LLMs writ large. They do not "know" or "think" or "believe" or "guess" or "consider" or "assume" or any other verb that implies cognition. They just assemble bits of language together based on patterns they learned from reading what humans have written. Your term "verbiage engine" is my new favorite...thank you for that. 🙂