From a live tweet of the proceedings around the lawyer caught using ChatGPT:
"I thought ChatGPT was a search engine".
It is NOT a search engine. Nor, by the way are the version of it included in Bing or Google's Bard.
Language model-driven chatbots are not suitable for information access.
>>
Honestly, this lawyer is actually lucky, bc he is working within a system that was able to catch his misstep.
When MSFT, GOOG & others present their chatbots as a replacement for search, they are setting people up for similar fails, typically in much less regulated spaces.
>>
@emilymbender Other take. ChatGPT is /not/ Bing, Google, etc. And the lawyer wasn't using them. Those are marketed as search aids, and if they make up search results I think there's an argument to be made about not being fit for purpose. They've had to go to a lot of engineering to try and constrain LLMs to actual search results.
ChatGPT was explicitly not that. That lawyer is lucky he wasn't disabarred for incompetence.
Prof. Emily M. Bender(she/her)
Brad Edwards
James Oh