Spring Jo 🥚 
🍀Apple did the research; LLMs cannot do formal reasoning. Results change by as much as 10% if something as basic as the names change.
https://garymarcus.substack.com/p/llms-dont-do-formal-reasoning-and
MOVED TO @@ShadowJonathan not to sound antiintellectual, but isn't it kinda obvious that a *text* generator, no matter how complex, can't do abstract reasoning?
Scott Feeney@halva @ShadowJonathan yeah, I appreciate the demonstrations, but this feels a little like, "New study confirms bicycles cannot fly."
Bunny Jane's Humansona@graue @halva @ShadowJonathan yeah, but there's a lot of people out there saying bicycles can fly. Sometimes you gotta do the science just to have something on paper to smack the idiots with.