“Elegant and powerful new result that seriously undermines large language models”

Like I’ve been saying for a while now: LLMs do not think or reason. They are not on the path to AGI. They are extremely limited correlation and text synthesis machines. https://garymarcus.substack.com/p/elegant-and-powerful-new-result-that

Elegant and powerful new result that seriously undermines large language models

Wowed by a new paper I just read and wish I had thought to write myself. Lukas Berglund and others, led by Owain Evans, asked a simple, powerful, elegant question: can LLMs trained on A is B infer automatically that B is A? The shocking (yet, in historical context, see below, unsurprising) answer is no:

Marcus on AI
@baldur "X is Y" does not imply "Y is X"; that's a logical fallacy.
@antlersoft @baldur sometimes “is” refers to an equivalence relation, in which case the implication is true. Sometimes “is” doesn’t mean an equivalence relation, that’s literally been the unsolved problem in neural nets for decades that the article discusses.