RE: https://social.coop/@natematias/116606979531755936

"Expecting correctness from #GenAI is like expecting #perpetualmotion from a machine. Gen AI has no concept of correctness. And even if it did, GenAI favors plausible falsehoods over unlikely truths. And unlikely truths are the heart of scientific discovery. "

@glynmoody Exactly! Karl Popper told us that science is not (as the popular opinion of his time held) about accumulating observations to confirm some likely theory. Quite the opposite, the most informative theories are always the most πŸ‘‰πŸΌimprobableπŸ‘ˆπŸΌ, because there are more ways they might be found to be wrong.

LLMs will never be capable of bold conjectures that go far beyond what we already know, because all they do is distill existing knowledge into plausible-sounding text. That's how they work.

@ApostateEnglishman @glynmoody correction: not 'knowledge' but existing published scraped text in the right language.

@UkeleleEric @glynmoody Well, Karl Popper didn't make that distinction! Anything written down or recorded anywhere in a manner that could be widely understood was "knowledge" to him, and rational people should accept only the most rigorously tested parts as provisionally true (but never proven).

This was part of his rejection of subjectivist epistemologies. But we digress. 😏

@glynmoody WELL AKSHUALLY AI already helped doing some big boy math proofs.
@photom you're right, it did; that's precisely where it can be useful