Chatbots don’t make sense – they make words

Despite the hype surrounding advanced Large Language Models like GPT-4, there is yet to be any evidence that these kinds of AI can think. In this post, I'm exploring how chatbots are built and trained, and why a little technical understanding goes a long way. Knowing even the broad strokes of how large language models are constructed helps to understand why they "hallucinate" (I prefer fabricate) information, why the output isn't grounded in any real truth, and why, ultimately, they don't […]

https://leonfurze.com/2023/11/22/chatbots-dont-make-sense-they-make-words/