I think this is an interesting argument – there's a lot here but I'll pick out the idea that AI is not "consciousness" or "intelligence" but the discovery of "something completely unforeseen about the statistical properties of large corpuses of text".
I've been trying to explain lately where the illusion of intelligence comes from and I think that is basically it. It is the latent "intelligence" of a huge volume of human-written text exploring the possibility space.
https://www.theatlantic.com/philosophy/2026/06/no-artificial-intelligence-is-not-conscious/687378/

