RE: https://mastodon.nz/@leighelse/116149727745113480

I worked on a large scale project testing medical transcription. (Maybe one of the largest ones) Hundreds of doctors reviewed the output and called out the issues.

It was not, and still is not, ready. Public health teams that roll this out without red teaming and remediation and feedback and a way to influence the weights of models are irresponsible.

@skinnylatte It's incredible that any organisation in the medical field should be so trusting. If it was a new physical device it would go through enormous amounts of testing before it ever got near a patient. Why should software be different?