William PietriTime to start a series of posts on how LLMs don't actually know anything! https://thetrek.co/they-trusted-chatgpt-to-plan-their-hike-and-ended-up-calling-for-rescue/ 1/
LLMs don't actually know anything. https://futurism.com/therapy-chatbot-addict-meth 2/
LLMs don't actually know anything. https://www.nationalobserver.com/2025/06/17/news/alltrails-ai-tool-search-rescue-members
3/
3/
LLMs don't actually know anything! https://gizmodo.com/rfk-jr-says-ai-will-approve-new-drugs-at-fda-very-very-quickly-2000622778
LLMs don't actually know anything. (And they'll make that your problem!) https://www.holovaty.com/writing/chatgpt-fake-feature/
7/
7/
LLMs don't actually know anything. 8/
https://x.com/jasonlk/status/1946069562723897802 (via @nixCraft )
https://x.com/jasonlk/status/1946069562723897802 (via @nixCraft )
JFC, LLMs don't actually know anything! 9/ https://gizmodo.com/billionaires-convince-themselves-ai-is-close-to-making-new-scientific-discoveries-2000629060
A sketchy doctor put two people in the hospital in critical condition. But he's convinced it's not his fault, because "an artificial intelligence app" told him it wasn't. He has yet to realize: LLMs don't actually know anything. 10/
https://www.propublica.org/article/peptide-injections-raadfest-rfk-jr
LLMs don't actually know anything. 11/
https://writing.exchange/@Harlander/115063980995867850
https://writing.exchange/@Harlander/115063980995867850
LLMs don't actually know anything. 12/ https://www.404media.co/google-ai-falsely-says-youtuber-visited-israel-forcing-him-to-deal-with-backlash/
LLMs don't actually know anything. 13/
https://www.bbc.com/travel/article/20250926-the-perils-of-letting-ai-plan-your-next-trip
https://www.bbc.com/travel/article/20250926-the-perils-of-letting-ai-plan-your-next-trip
LLMs especially don't know anything about the law. 14/
https://www.404media.co/18-lawyers-caught-using-ai-explain-why-they-did-it/
eswillwalker@williampietri Also interesting that it is the lawyers who are being blamed rather than the AI programs that produced the fictitious cases, citations, and quotes. Why are the IA programs considered innocent? The companies that build them know that these programs make false assertions. It seems to me that the fact that these companies push these programs as “useful” amounts to a lie, i.e. a known falsehood stated with self-serving malicious intent.
Jef Poskanzer@ELS @williampietri Yep. Charge them all with conspiracy to defraud.
@jef @ELS I'd love to see it! Although I think this is a case of that wonderful Tom Waits line, "The large print giveth and the small print taketh away." [1] I expect that they've adequately disclaimed themselves in a way that legally puts the responsibility on the user. Just one more benefit of rugged American individualism!
Plus I think the judges tend to keep their wrath to those who step into their courtroom, and it'd be hard for a lawyer to admit they got rooked by marketing fluff. Being rugged individualists, and all.
[1] Which has a great marketing-related story of its own: https://en.wikipedia.org/wiki/Step_Right_Up_(song)
Jack Yan (甄爵恩)@williampietri @jef @ELS At a very basic level, they could all be done for negligence since it was foreseeable, you might be able to argue they had a duty of care to ensure accuracy that was breached, you can show the causal link, and there definitely was damage. (I also say this about the entire Google ad ecosystem which helps fund disinformation.)