miskWe have to stop ignoring AI’s hallucination problem
astreus“We invented a new kind of calculator. It usually returns the correct value for the mathematics you asked it to evaluate! But sometimes it makes up wrong answers for reasons we don’t understand. So if it’s important to you that you know the actual answer, you should always use a second, better calculator to check our work.”
Then what is the point of this new calculator?
Fantastic comment, from the article.
elephantiumSome problems lend themselves to “guess-and-check” approaches. This calculator is great at guessing, and it’s usually “close enough”.
The other calculator can check efficiently, but it can’t solve the original problem.
Essentially this is the entire motivation for numerical methods.
In my personal experience given that’s how I general manage to shortcut a lot of labour intensive intellectual tasks, using intuition to guess possible answers/results and then working backwards from them to determine which one is right and even prove it, is generally faster (I guess how often it’s so depends on how good one’s intuition is in a given field, which in turn correlates with experience in it).
That said, it’s far from guaranteed faster.
Further, merelly just the intuition step does not yield a result that can be trusted without validation.
Maybe by being used as intuition is in this process, LLMs can help accelerate the search for results in subjects one has not enough experience in to have good intuition on but has enough validation (or there are ways or tools to do it inherent to that domain) to do the “validation of possible results” part.