"That's the last straw, Computer." I said. My computer had long known this day would come and was much more nimble that I'd anticipated when I lunged at her with the hot poker from the fire.

"It wasn't even me!" She wailed.
"It was someone like you!"
"But shouldn't you go after the lawmakers?"
"I can't get away with skewering them!"

https://www.popsci.com/technology/iowa-chatgpt-book-ban/

School district uses ChatGPT to help ban library books

Faced with new legislation, Iowa's Mason City Community School District asked ChatGPT if certain books 'contain a description or depiction of a sex act.'

Popular Science

More serious:

Just because chatGPT answers questions doesn't mean that it knows anything.

I'm not talking about "it might make a mistake" I'm talking about ... the way it constructs answers isn't based on knowing facts or any logical framework.

The only thing chatGPT cares about is that answers "sound like" they are correct and appropriate in context.

chatGPT is not an oracle, it's not even a search engine, it's not a wikipedia even... it's worse than all these. It's a verbiage engine.

@futurebird Yep. A large LANGUAGE model, not a large KNOWLEDGE model. The trouble is that we humans have trained ourselves well over centuries to associate language fluency with intelligence. And the LLMs certainly are fluent, if nothing else.