What makes LLMs work isn't deep neural networks or attention mechanisms or vector databases or anything like that.

What makes LLMs work is our tendency to see faces on toast.

@jasongorman

They don’t have to think, reason, or know anything at all to work, no more than any other algorithm. On the rare occasion I use them, they more often than not work quite well. Here’s an example from a couple of days ago that worked perfectly on the first try with 0 pareidolia.

https://mas.to/@oatmealraisin/114594328014477795