Maybe a better analogy for people who still think "chat AI" knows what it's saying is that it's like a parrot. Parrots can talk like humans but they don't have any idea what they're saying. They're just repeating patterns of sound they've heard us make. If you ask a parrot a question enough times it can even learn that after the sound pattern that your question made another pattern follows that makes up the answer. It still doesn't know what you're asking it, or what the answer means. It's just making sound patterns

These AIs are doing the exact literal same thing with letters. It doesn't mean anything, because it doesn't understand any of it, because IT'S A FUCKING PARROT, BRENT

Now, parrots are cool! Their ability to seemingly answer human questions is a really neat party trick!

But you wouldn't replace human answers with parrot provided answers in a serious setting with any kind of stakes. That's exactly what relying on something like chatgpt is

@eniko Also it's hard to see how a cool party trick is going to cause some kind of disruptive revolution. At this point it mainly just costs a lot of money.
@Tijn I mean, it will be very disruptive if they start replacing jobs like therapists with party tricks >_>