When people seek medical diagnoses and recommendations from LLMs in the real world, the chatbots perform worse than they do when tested in the lab, and worse than the results that people achieve using search engines.

Summary: https://www.sciencenews.org/article/medical-advice-ai-chatbots-symptoms

Original paper: https://www.nature.com/articles/s41591-025-04074-y

#Science #Health #Medical #Diagnoses #AI #LLMs

Real-world medical questions stump AI chatbots

Subtle shifts in how users described symptoms to AI chatbots led to dramatically different, sometimes dangerous medical advice.

Science News

444 ๐—ป๐—ถ๐—ฒ๐˜‚๐˜„๐—ฒ ๐—ต๐—ถ๐˜ƒ-๐—ฑ๐—ถ๐—ฎ๐—ด๐—ป๐—ผ๐˜€๐—ฒ๐˜€, ๐˜ƒ๐—ผ๐—ผ๐—ฟ๐—ฎ๐—น ๐˜๐—ผ๐—ฒ๐—ป๐—ฎ๐—บ๐—ฒ ๐—ฏ๐—ถ๐—ท ๐—บ๐—ฒ๐—ป๐˜€๐—ฒ๐—ป ๐—ด๐—ฒ๐—ฏ๐—ผ๐—ฟ๐—ฒ๐—ป ๐—ถ๐—ป ๐—ท๐—ฎ๐—ฟ๐—ฒ๐—ป 80 ๐—ฒ๐—ป 90

Vijftien jaar lang daalde het aantal hiv-diagnoses in Nederland, maar inmiddels wordt het virus dat aids kan veroorzaken jaarlijks bij ongeveer hetzelfde aantal mensen aangetroffen. Vorig jaar kregen 444 mensen te horen dat ze hiv hebben opgelopen.

https://www.rtl.nl/nieuws/binnenland/artikel/5539820/hiv-diagnoses-daalt-niet-meer-vooral-stijging-bij-mensen-geboren

#hiv #diagnoses #toename

444 nieuwe hiv-diagnoses, vooral toename bij mensen geboren in jaren 80 en 90

Vijftien jaar lang daalde het aantal hiv-diagnoses in Nederland, maar inmiddels wordt het virus dat aids kan veroorzaken jaarlijks bij ongeveer hetzelfde aantal mensen aangetroffen. Vorig jaar kregen 444 mensen te horen dat ze hiv hebben opgelopen.

RTL Nieuws
Me and you and our #diagnoses A perfect match in a bag of explosives Ancient conditions With brand-new solutions Me and you and our trauma flashbacks #KaeTempest #live tonight! CPTSD, ADHD, anxiety Bipolar, addiction, neurodivergence I'd be more worried if we weren't disturbed #music #hiphop

Kae Tempest - Diagnoses (Offic...
Kae Tempest - Diagnoses (Official Video)

YouTube
Thursday! #CPTSD, #ADHD, #OCD and #PMDD Anxious attachment, TBI But it's the world that's sick, baby, we're alright CPTSD, ADHD, anxiety Bipolar, addiction, neurodivergence I'd be more worried if we weren't disturbed! #KaeTempest - #Diagnoses #music #spokenwords #rap #hiphop youtu.be/Qup3Y60TmTE

Kae Tempest - Diagnoses (Offic...
Kae Tempest - Diagnoses (Official Video)

YouTube

Tackling resistant #bacteria requires effective antibiotics and fast and reliable #diagnoses. With the support of the SNSF, microbiologists are fishing for Escherichia coli to allow the bacterium to be detected and captured more quickly.๐Ÿฆ ๐ŸŽฃ

โžก๏ธ https://sohub.io/fejx

Kae Tempest - Diagnoses (Official Video)

YouTube
"AI already helps #clinicians to make #diagnoses, triage critical cases & transcribe clinical notes.. But #regulation of #medical #AI products hasn't kept up w te rapid pace of adoption.. Unlike most other #FDA-regulated prods, AI tools continue to evolve aft approval as they r updated or retrained.. Tis raises te need for continuous #oversight.. The discussion is especially timely amid recent signs tt te #federal #government might #scaleback #AIregulation"
#GenAI #ethics
https://flipboard.com/@naturenewsteam/latest-science-news-d3hg9j0hz/-/a-MACPuxkMSDSPMkZ-O_K1pw%3Aa%3A166866041-%2F0
Medicine's rapid adoption of AI has researchers concerned

Hospitals and universities must step up to fill gaps in regulation, experts say. Artificial intelligence (AI) already helps clinicians to make โ€ฆ

nature.com - Mariana Lenharo

A couple of review of a new book "The Age of Diagnosis" that suggests that the increasing prevalence of once-rare conditions is due to an overdiagnosis epidemic.

https://undark.org/2025/05/09/book-review-age-of-diagnosis/

https://openlettersreview.com/posts/the-age-of-diagnosis-by-suzanne-osullivan

It's not evident that the book's author addresses neglect of base rates in diagnoses, but that is possibly a related issue.

Note that the author evidently has a critical view of the expanding diagnoses of autism and ADHD.

#Medicine #Diagnoses #Health

Book Review: A Clear-Eyed Look at the Risks of 'Diagnosis Creep'

In โ€œThe Age of Diagnosis,โ€ Suzanne Oโ€™Sullivan challenges some common assumptions about how we detect and treat disease.

Undark Magazine

Ummm.... @actuallyautistic

Hereโ€™s the data the #NIH can collect from your medical history for its โ€˜#autism databaseโ€™

Story by Julia Musto, 4/23/2025

Excerpt: "While it remains unclear exactly what data will be collected, under the presented platform NIH researchers could have access to:

- Americansโ€™ #prescription information, including the type of medication and how they are prescribed
- Data collected during medical studies in a multitude of areas and from public and private institutions
- Data collected from peoplesโ€™ #smartwatches, which can range from heart health to sleep patterns
- #Claims from private insurers that can cover items such as lengthy hospital stays, #screening and testing
- Data from the Centers for #Medicare and #Medicaid Services, which includes #referrals to specialists, enrollment, #diagnoses, and more "

https://www.msn.com/en-us/health/other/here-s-the-data-the-nih-can-collect-from-your-medical-history-for-its-autism-database/ar-AA1DtLpS?ocid=winp2fptaskbarent&cvid=b3b3403a0af048938868e5c93ad98c8f&ei=9

#HIPPA #HIPPAViolations #RFKJr #Fascism #Eugenics #USPo

MSN

๐—™๐—น๐—ถ๐—ป๐—ธ๐—ฒ ๐˜๐—ผ๐—ฒ๐—ป๐—ฎ๐—บ๐—ฒ ๐—ฑ๐—ถ๐—ฎ๐—ด๐—ป๐—ผ๐˜€๐—ฒ๐˜€ ๐—ฝ๐—ฟ๐—ผ๐˜€๐˜๐—ฎ๐—ฎ๐˜๐—ธ๐—ฎ๐—ป๐—ธ๐—ฒ๐—ฟ ๐—ฑ๐—ผ๐—ผ๐—ฟ ๐˜ƒ๐—ฒ๐—ฟ๐—ด๐—ฟ๐—ถ๐—ท๐˜‡๐—ถ๐—ป๐—ด ๐—ฏ๐—ฒ๐˜ƒ๐—ผ๐—น๐—ธ๐—ถ๐—ป๐—ด

Er is een flinke toename in het aantal diagnoses van prostaatkanker bij mannen. Waar borstkanker nog de meest voorkomende vorm van kanker was, zit prostaatkanker daar nu heel dicht bij. Dat blijkt uit jaarlijkse cijfers van het Integraal Kankercentrum Nederland (IKNL). Oorzaak van...

https://www.rtl.nl/nieuws/binnenland/artikel/5492586/prostaatkanker-cijfers

#prostaatkanker #vergrijzing #diagnoses

Flinke toename diagnoses prostaatkanker door vergrijzing bevolking

Er is een flinke toename in het aantal diagnoses van prostaatkanker bij mannen. Waar borstkanker nog de meest voorkomende vorm van kanker was, zit prostaatkanker daar nu heel dicht bij. Dat blijkt uit jaarlijkse cijfers van het Integraal Kankercentrum Nederland (IKNL). Oorzaak van de toename is volgens het centrum te verklaren aan de groei en vergrijzing van de Nederlandse bevolking.

RTL Nieuws