Chris HallAug 9, 2025

Why are LLMs so bad at being accurate? And why do people use them for research despite them being so inaccurate?

#LLM #AI #Research #Accuracy

https://www.christopher-james-hall.com/blog/llm-accuracy-and-implications-for-research

Just ask chat? Why are LLMs so inaccurate? — Platform Journalism

AI is a big deal at the moment. Grants are given to research that involves AI. Job ads are asking for AI knowledge or skills. And the first step in learning for many undergraduates, fresh out of high school, is to “just ask chat”. What’s more, the newest version of ChatGPT apparently has “ new PhD a

Platform Journalism
Show threadbeasom
@Platform_Journalism The best test of LLMs is to do exactly what you did: ask it about something you know well. Every type of misrepresentation and inaccuracy in that response is present in *all* responses to querys, you just don’t notice them because if you’re using an LLM to tell you about it you are presumably not knowledgeable about that topic.
Sep 5, 2025 at 11:52pmIvory for iOS
Show threadAklysSep 24, 2025

@beasom @Platform_Journalism I had this same problem with the academic system. I thankfully did courses I was already trained in and had to point out the many problems with their content they were delivering.

Some courses I had to demand a refund after proving there was too many mistakes and I didn't want to continue into areas I didn't know due to the number of identified problems with their course material.