By now you know that #ChatGPT will make up nonsense, presented with confidence.

Useful framework by AI and Data Policy lawyer:

@jvt In my line of work, I get asked if we can use ChatGPT to generate clinical reports for cancer patients. My answer comes in 3 parts:

1. No.
2. Absolutely not.
3. Trusting life-or-death decisions about cancer treatment to Chat-GPT is not merely irresponsible, it's something you'd make up as an illustration of the worst possible use case.

@iain_bancarz ooof that’s hilarious but also very, very scary
@iain_bancarz @jvt @VulpineAmethyst 3 = there will be 3 startups trying to promote this by the end of the day then?

@chloeraccoon @jvt @VulpineAmethyst They can try if they want to. But thankfully there are laws and regulations governing medical reports.

Medical regulators would have a strongly negative response to Chat-GPT in a clinical setting.

In less formal terms, anyone seriously asking to do it would be yeeted into the sun. 😀

@iain_bancarz @jvt @VulpineAmethyst *eyes the current government here...* yeah, like I'd trust that to all stay in place if someone offered money/cut down on waiting times/reducing in costs by cutting out patients...

@chloeraccoon @jvt @VulpineAmethyst I dislike the current UK government so much I moved to another continent to get away from it.

But even they are unlikely to burn clinical regulation to the ground and allow diagnosis by magic 8-ball, which is what Chat-GPT amounts to. (That said, no matter how low you set your expectations, this lot have a way of tunnelling underneath them...)

@iain_bancarz @jvt please tell me that’s made up to prove a point?
@paulmwatson @jvt I'm afraid not. This was a question from the audience when I gave a talk last week. I can only hope the questioner was not entirely serious. 🙃

@iain_bancarz @jvt reminiscent of MYCIN, the first medical expert system. Developed to prescribe treatments for infections, it had no knowledge of its own limitations. If you told it the patient's symptoms are "the patient is dead" it would still respond with a prescription.

https://users.cs.cf.ac.uk/Dave.Marshall/AI1/mycin.html