‘Unbelievably dangerous’: experts sound alarm after ChatGPT Health fails to recognise medical emergencies | ChatGPT | The Guardian
https://www.theguardian.com/technology/2026/feb/26/chatgpt-health-fails-recognise-medical-emergencies
Why did anyone even think this was a good idea?
ChatGPT Health was launched in January 2026 as OpenAI’s consumer health tool and has reached millions of users. Here we conducted a structured stress test of triage recommendations using 60 clinician-authored vignettes across 21 clinical domains under 16 factorial conditions, yielding 960 total responses. Performance followed an inverted U-shaped pattern, with the most dangerous failures concentrated at clinical extremes—nonurgent presentations (35%) and emergency conditions (48%). Among gold-standard emergencies, the system undertriaged 52% of cases, directing patients with diabetic ketoacidosis or impending respiratory failure to 24–48 h evaluation rather than the emergency department, while correctly triaging classical emergencies such as stroke and anaphylaxis. When family or friends minimized symptoms, indicating anchoring bias, triage recommendations shifted significantly in edge cases (odds ratio = 11.7, 95% confidence interval = 3.7–36.6), with the majority of shifts toward less urgent care. Crisis-intervention messages activated unpredictably across suicidal ideation presentations, occurring more frequently when patients described no specific method than when they did. Patient race, sex and barriers to care did not show significant effects, although confidence intervals did not exclude clinically meaningful differences. These findings reveal missed high-risk emergencies and inconsistent activation of crisis safeguards, raising safety concerns that warrant prospective validation before consumer-scale deployment of artificial intelligence triage systems. A stress test of ChatGPT Health triage revealed missed high-risk emergencies and inconsistent activation of suicide-crisis safeguards, raising safety concerns for consumer-scale deployment.
The Conversation: ChatGPT Health promises to personalise health information. It comes with many risks . “ChatGPT Health promises to generate more personalised answers, by allowing users to link medical records and wellness apps, upload diagnostic imaging and interpret test results. But how does it really work? And is it safe?”
https://rbfirehose.com/2026/01/30/the-conversation-chatgpt-health-promises-to-personalise-health-information-it-comes-with-many-risks/The Conversation: ChatGPT Health promises to personalise health information. It comes with many risks . “ChatGPT Health promises to generate more personalised answers, by allowing users to li…
Flaws in ChatGPT Health Can Lead to Baseless Health Analyses
#AI #ChatGPT #ChatGPTHealth #OpenAI #AIIntegration #MedicalAI #ConsumerHealth
ChatGPT Health: IA e saúde aos olhos da mídia
No mundo, 230 milhões perguntam sobre saúde à plataforma da Open AI. Uma minoria entende como funciona. Seu novo produto promete analisar dados médicos dos usuários. Como a IA impacta a cultura, os meios de comunicação e as políticas públicas de saúde?https://outraspalavras.net/outrasaude/chatgpt-health-ia-e-saude-aos-olhos-da-midia/