Mastodawn

Microsoft says its new AI tool diagnoses diseases with 80% accuracy vs. doctors' 20%; Mustafa Suleyman calls it a "step toward medical superintelligence" (Will Knight/Wired)

https://www.wired.com/story/microsoft-medical-superintelligence-diagnosis/
http://www.techmeme.com/250630/p14#a250630p14

Microsoft Says Its New AI System Diagnosed Patients 4 Times More Accurately Than Human Doctors

The tech giant poached several top Google researchers to help build a powerful AI tool that can diagnose patients and potentially cut health care costs.

WIRED

Show thread

Greg Linden

@Techmeme Not sure about this claim because it sounds like the AI tool could search for the answers but the humans could not. From the paper: "possible that some off-the-shelf models were trained on [part of the test set but] ... we asked the [doctors] in our study to refrain from using search engines." The Wired article has good quotes at the end saying a real clinical trial would be a better evaluation, but this evaluation doesn't justify strong conclusions.
https://arxiv.org/pdf/2506.22405