The most hilarious and horrible side-effect of LLMs is that we now have a definitive answer to the question implied by Searle's Chinese Room thought-experiment.
Anthropic and OpenAI have built the Chinese Room. And while it's clear now that there's no ghost in the machine, lots of people think they're having a real conversation ... https://mstdn.ca/@michaelgemar/115243456306059266