John Rogers1d ago
Bloody hell. Researchers invented a disease, published two fake papers to see if LLM’s would ingest them and kick them up as fact — and then it broke containment and all the major AI’s bought in. Information pollution. www.nature.com/articles/d41...

Scientists invented a fake dis...
Scientists invented a fake disease. AI told people it was real

Bixonimania doesn’t exist except in a clutch of obviously bogus academic papers. So why did AI chatbots warn people about this fictional illness?

Show threadJW
@johnrogers.bsky.social
Not surprised. A major problem with LLMs is the way they are trained. Sucking in without checking if its pure fiction, fact, lies purporting to be factual, etc first is a simple example of garbage in garbage out (GIGO)
Apr 10 at 12:07amWeb