Now I didn't pay much attention at the time because I thought it was arrant nonsense, LLMs obviously can't be sentient, we all know how that stuff works, end of debate.

But... let me play devil's advocate based on a fascinating bit of physics that many people probably aren't aware of.

Perhaps the most fascinating course I took during my physics master's was a 4th year one called 'Phase Transitions and Collective Phenomena'. It was about... well as Phil Anderson put it, 'More Is Different':

https://www.tkm.kit.edu/downloads/TKM1_2011_more_is_different_PWA.pdf

With general relativity and quantum field theory etc any smart teenager with an interest in physics already knows the punchline, so the courses were just a bit of algebra you had to plough through. With phase transitions it was like 'whoah, what *is* this stuff?!?'

You can start from the simplest possible toy models that a 13 year-old would understand, say a spin being either up or down and the energy for a pair of neighbouring spins being -1 if they point in the same direction and +1 if they point in opposite directions (and then summed over all neighbouring pairs of spins), aka the Ising model -

https://en.wikipedia.org/wiki/Ising_model

... and yet if you have a system that's big enough, you get phase transitions during which, well, some very weird stuff happens!

The key is 'big enough', this only really works for very large systems (ideally infinite ones!) as measured by the number of components (eg spins in the Ising example above).

The fascinating thing is that what happens during a phase transition is largely independent of the details of the system and is instead governed by something called its universality class:

https://en.wikipedia.org/wiki/Universality_class

And as you can see if you click on the Wikipedia link:

https://en.wikipedia.org/wiki/Universality_class

... for most universality classes that are currently known (which usually include some *incredibly simple toy models* that exhibit them such as the Ising model above for interacting spins), we can't even calculate the critical exponents that characterise the phase transition from first principles! The best we can do is run a simulation of the toy model on a computer and measure them.