Taggart 2d ago

This entire report from the Ontario government on genAI systems is worth a read, but the review of healthcare scribe accuracy is pretty devastating, imo. This has to work for the tech to be worth anything. If the notes in the chart are wrong, the whole thing falls apart.

https://www.auditor.on.ca/en/content/specialreports/specialreports/en26/2026_AI_EN.pdf

Show threadglnfld2d ago
@mttaggart Skimmed this... But on top of your screenshot, 60% also recorded the wrong prescribed drug. Why are none of the recommendations not to use AI systems that cannot accurately and precisely perform the required job? One of the recommendations is actually to *increase* AI use, despite the aforementioned evidence that 25-60% of the information the scribes provide being useless.
Show threadTaggart 
@glnfld Yeah the idea that this is a fool's errand is never examined.
May 17 at 12:25amWeb
Show threadJay 🆘1d ago

@mttaggart @glnfld For three plus years, the assumption that AI is *just about* to get accurate and stop hallucinating has persisted.

What is this assumption based on?