@emilymbender Discovering that a chat bot's data is inconsistent with its sources is often trivial. I've had fun asking GPT-3 questions about the rules of Scrabble, especially around how many tiles there are for each letter, and whether you can spell out certain words with and without blank tiles. The answers are internally inconsistent, don't correspond with actual Scrabble rules, and don't even correspond with the source material that GPT-3 pointed me to when I asked it how it "knew".

@markproxy I am well aware. I wasn't asking for experience reports with GPT-3 or any other LLM with that post.

@emilymbender I meant merely to support your point with an illustrative example from my own experience, in the context of conversation around an important topic. I can see how it might have come across differently; sorry for that!