Science cannot live by LLM alone, part 12,386.

As an experiment, Almira Osmanovic Thunström published fake papers about a fake eye disease that credited Professor Maria Bohm of Starfleet Academy. They were said to be funded by the Professor Sideshow Bob Foundation in partnership with the University of the Fellowship of the Ring.

Despite such obvious trickery, within a few weeks, chatbots were citing the studies as real:
https://www.nature.com/articles/d41586-026-01100-y

Scientists invented a fake disease. AI told people it was real

Bixonimania doesn’t exist except in a clutch of obviously bogus academic papers. So why did AI chatbots warn people about this fictional illness?

@mattsheffield
#ArtificialStupidity : scientific literature edition