#ChatGPT can pass exams that a majority of students can't"

i think this says more about how our education relies on non-introspective reproduction of information than it says about the future of computing

like, it just shows that our education systems are incompatible with actual humans when a computer is better at it?

@bram It's very dangerous that the rate of improvement of LLMs is so unequal across areas, it fools people. ChatGPT has no model of most concepts.

The couple of emergent properties that appear in it combined with the insane amount of data they can regurgitate are enough to wow people and make them think it's a genius, while it's more at the level of a little human child on a lot of actual reasoning tasks and absolutely terrible at some, but its use of language and emotional mimicry is expert.

@bram It's a bit like a child with an encyclopedia strapped to its head, it can talk about most things like someone who heard a vague description of them, but it has never seen them.

There are some things where I feel it has something approaching understanding of it, because it actually has the thing in its dataset, those are abstract things like a Linux shell and simple snippets of code. It's good enough to not only write about them but simulate them, indicating some kind of model.