| Website | https://guolivar.github.io |
| Website | https://guolivar.github.io |

Hallucination has been widely recognized to be a significant drawback for large language models (LLMs). There have been many works that attempt to reduce the extent of hallucination. These efforts have mostly been empirical so far, which cannot answer the fundamental question whether it can be completely eliminated. In this paper, we formalize the problem and show that it is impossible to eliminate hallucination in LLMs. Specifically, we define a formal world where hallucination is defined as inconsistencies between a computable LLM and a computable ground truth function. By employing results from learning theory, we show that LLMs cannot learn all the computable functions and will therefore inevitably hallucinate if used as general problem solvers. Since the formal world is a part of the real world which is much more complicated, hallucinations are also inevitable for real world LLMs. Furthermore, for real world LLMs constrained by provable time complexity, we describe the hallucination-prone tasks and empirically validate our claims. Finally, using the formal world framework, we discuss the possible mechanisms and efficacies of existing hallucination mitigators as well as the practical implications on the safe deployment of LLMs.
People who can comfortably live off 30% of their income cluelessly explaining savings to people who can barely live off 100% of theirs is a phenomenon I encounter way too often.
YOU'RE NOT BETTER AT BUDGETING YOU JUST HAVE MORE MONEY.
Me, an idiot: “So, kids, by setting the thermostat a little lower and eating less meat, we’re doing our part to make the world more sustainable”
VCs, very smart: “We just raised $100 billion dollars from the sovereign wealth funds of three petrostates to build the world’s largest AI supercomputer. It uses as much power and water as Guatemala and the primary use case is for management consultants to autogenerate powerpoints for justifying mass layoffs.”
White, abled tech-literate people: gosh, creating safe online communities is a really hard problem that nobody is thinking about and we may never have answers to all these tough questions...
Literally the rest of the world: well, uh, you could start by---
White people: I SAID WE MAY NEVER HAVE ANSWERS