The counterargument in the ChatGPT lawyer debacle is that the AI's summarization of the precedent, being based on a statistical summary of the relevant legal debates, is a better Hayekian distillation of the common law tradition than any ordinary exercise in legal pedantry carried out by humans combing Westlaw. The hallucinated citations are a purer form of the caselaw than any merely existing cases in our sordid sublunar realm could possibly aspire to being.
@henryfarrell Let's all just surrender to whatever the average of the internet is on givent topic and then we win by mass generating content that supports our views for other models to learn on.