Got obsessed with this story!

It's a wild one.

It's about ChatGPT, lawyers, and a very angry judge. The details are juicy, and the implications are huge. Let's dig in. 🍿

⚖️ 3 characters are important: Roberto Mata (plaintiff), Steven Schwartz (attorney), Peter LoDuca (attorney on record).

Mata sues Avianca airlines through Schwartz at state court. Avianca transfers the case to Manhattan's federal court. This is when things get interesting. 🕵️‍♂️

🧵 1/n

#AI #chatgpt #law #academia #mastodon

Schwartz can't practice there, so he enlists LoDuca as the attorney on record. Here's the catch: LoDuca does zero research, and everything is handled by Schwartz. Mata's lawyers file the brief, but Avianca calls bluff—none of the cited cases exist! 😱 #BluffCalled

Where did the fake cases come from? You guessed it—our favorite ChatGPT hallucinated up the whole thing! 🤯 #ChatGPT hallucinated the whole thing! The cited cases seemed plausible, fooling even experts.

2/n

Judge asks them to back up their claims. Schwartz goes back to ChatGPT and asks for the cases. As expected, ChatGPT obliges. But, the problem again is: all of it is fabricated.

Schwartz submits the ChatGPT generated output. Not just that, both Schwartz and LoDuca sign affidavits, which makes things even worse.

3/n

Now the judge is super pissed. Sh*t gets real. Schwartz confesses that he was "unaware of the possibility that [ChatGPT's] content could be false." He even shares screenshots where he asks ChatGPT to verify, and it confirmed everything was right.

Legal experts claim there are malpractice implications. Schwartz's law firm could be in trouble. More details will emerge on June 8, 2023.

So, who's at fault? What are the implications?

4/n

So, who's at fault? What are the implications?

💡 Placing all blame on the lawyers is too simplistic. Yes, they goofed up royally, but is that all there's to it?

What about how OpenAI marketed ChatGPT as an all-knowing, general-purpose tool? Yes, the disclaimers about limitations are there, but are they hyped in the same way its capabilities are hyped?

💬 ChatGPT is designed to output authoritatively, engendering user trust. But technology doesn't act on its own. Creators shape it.

5/n

What about AI hypesters and the grifters riding the hype train? 🚂

⚖️ Do these parties have any accountability? They all share responsibility. Schwartz is at fault, but widening accountability doesn't reduce his culpability. So, what's next? ⚠️ #Accountability #Responsibility

We can't afford to look at this issue in isolation. We need to see this from an ecosystem point of view—at an infrastructural level—so that we don't just treat the symptom but also the root causes behind it.

6/n

Resources:
🔗 Case Docket: courtlistener.com/docket/63107798/mata-v-avianca-inc/
📰 NYT: nytimes.com/2023/05/27/nyregion/avianca-airline-lawsuit-chatgpt.html

#AI #mastodon #responsibleai

7/7 (n=7)

@upol This is just the beginning. It's going to get a whole lot worse before it gets better.
@upol
Fundamentally, AI systems need to be verified. They "learn" on their own, from unknown sources (that needs to stop), so the interesting job area of the future is AI AUDITORS! Companies are going to incur legal liability for decisions they can't even trace. The solution is a market of 100 or more, sometimes specialized AIs, and they individually & independently are graded on accuracy. And once that happens for AI, it will begin happening for people as well, and I welcome it.
@upol to be honest, all my life someone has been promising me things authoritatively - I have learned to investigate further, I really think someone who managed to get all the way through law school could have double verified and not been that astronomically lazy and stupid.
@Htaggert sadly, they are. Lawyers have done worse. Sadly, that's the reality. It's a toxic mix of potentially high pressure work, lack of due diligence, and a falsely advertised product
@upol Former professional chef here. If I, as a restaurateur professional, purchase a product marketed as the very finest gourmet chocolate but is actually dog turds in fancy packaging and I proceed to make mousse out of it and serve that to my patrons, guess who deserves every lawsuit he's hit with? Professionals have a responsibility to check claims their suppliers make, you know.
Lay people have an excuse. Professionals do not.

@Eetschrijver @upol

As a chef you'd probably notice it by the smell and should stop it at that point.

Bet let's assume something less obvious: you use milk that is unclearly labeled as ok for lactose intolerance, and sell the mousse as good for lactose intolerance, and it leads to a case - who would get sued?

(Honestly, I have no idea)

@upol this is the best "unaware of the possibility that [ChatGPT's] content could be false."

Let us issue a command for the age of #misinformation:

You who are typing the prompts must be aware that all responses to the prompt are fabricated.