Tangentially, I'm also tired of the whole "The fascists have taken the wrong lesson from dystopian fiction!" people. For the love of all of our mental healths, THEY DO NOT CARE.

It's aesthetics to them. They do not give a single solitary shit that they don't understand the themes and morals of dystopian novels. Hell, we know they don't understand what they read; Elon Musk made a great display of entirely misunderstanding the point of Hitchhiker's Guide. He doesn't care that he doesn't know what it means; to him, it means what he says it means. It means what he forces it to mean.

That is how he sees it.

That is also not an education problem. That is a problem of how self-interested fascists (same thing) behave and believe the world to work. No amount of education is going to fix that.

I suspect LLMs reinforce the Gell-Mann amnesia effect. Experts who query LLMs about their fields of expertise will *quickly* realize how wrong their output can be, how quick they are to confabulate, and how eager they are to confirm one’s biases. Sometimes, replying “No, that’s wrong, try again” can cause an LLM to generate a completely different—and often opposite—answer to the same query, which makes no sense if the LLM had *actually* worked out an independently coherent answer.

Asking an LLM to comment about a subject you know nothing about—or worse, know a little bit about—is a psychologically dangerous activity. Not only will it confirm your biases, it will do so in a way that *appears* to be objective and independent, using fallacies that lie just beyond your ability to discern. At best, you will be misled. At worst, you will begin spiraling down a path of conspiracy thinking.

Be extremely suspicious of answers that are especially satisfying; you might have just gaslit yourself.

#ai

Also, and I want to say more on this soon, but if you think that the big AI players are hoping for *anything but* them being able to put a legislative moat around themselves where output *is* copyrighted and training materials *are* restricted but they're the *only ones* able to play, you're being a fool.

Their key goal is to capture rent on all intellectual pursuits.