From a live tweet of the proceedings around the lawyer caught using ChatGPT:
"I thought ChatGPT was a search engine".
It is NOT a search engine. Nor, by the way are the version of it included in Bing or Google's Bard.
Language model-driven chatbots are not suitable for information access.
>>
Honestly, this lawyer is actually lucky, bc he is working within a system that was able to catch his misstep.
When MSFT, GOOG & others present their chatbots as a replacement for search, they are setting people up for similar fails, typically in much less regulated spaces.
>>
Say it with me as many times as it takes to make the lesson stick: Chatbots are not a suitable replacement for search engines.
https://dair-community.social/@emilymbender/109570353001872254
Chatbots are not a good replacement for search engines https://iai.tv/articles/all-knowing-machines-are-a-fantasy-auid-2334
Doesn't this demonstrate just how poorly people understand what's going on behind search engines? And so the only thing they have left to judge output on is "how much does this sound like a person?". Big tech is definitely exploiting this, but how are we giving them anything else to go by?
For my part, I am putting enormous effort into educating the public about this, including with this thread and the one that it links to.
👍 That's excellent! The tech areas I follow aren't very good about doing that. Glad that you are.
@jztusk @emilymbender Bear in mind though, this wasn't a case of even using a search engine. That lawyer didn't use Bing chat, you.com or any other search engine that at least claims to provide results that exist somewhere.
The lawyer used ChatGPT. It's a make believe engine. And it's been widely advertised as such.
If that lawyer can't even bother to use an actual legal database, is the issue the tech platforms?
Prof. Emily M. Bender(she/her)
jz.tusk
Brad Edwards
OpenDNA⚙️