Bloody hell. Researchers invented a disease, published two fake papers to see if LLM’s would ingest them and kick them up as fact — and then it broke containment and all the major AI’s bought in. Information pollution. www.nature.com/articles/d41...

Scientists invented a fake dis...
Scientists invented a fake disease. AI told people it was real

Bixonimania doesn’t exist except in a clutch of obviously bogus academic papers. So why did AI chatbots warn people about this fictional illness?

@johnrogers.bsky.social This has been a known issue for a while; it's incredibly easy to pollute the data because the models have no capacity for critical thinking. If it's online and no one is disputing it, it's the truth