Axios: Exclusive: Researchers trick a bot that prescribes meds

"Security researchers used relatively simple jailbreaking techniques to trick the AI system powering Utah's new prescription refill bot.

Researchers were able to make the bot spread vaccine conspiracy theories, triple a patient's prescribed pain medication dosage, and recommend methamphetamine as treatment."

https://www.axios.com/2026/03/04/doctronic-utah-prescriptions-ai-jailbreak

#AI #doctor #health #prescription #utah

Exclusive: Researchers trick a bot that prescribes meds

The state of Utah is running a pilot with Doctronic's AI system to refill some prescriptions.

Axios

@ai6yr This is AGAIN why we fought tooth and nail against huge resistance from the hospital to include AI language in the contract that AI cannot replace a nurse or their judgement in patient care matters and the Nurse can override any prompts or advice if such a system is implemented

"Today, we reached agreement on a new provision addressing use of new technology, including AI. The new provision will confirm that use of technology should not limit a Nurse’s exercise of clinical judgment and that, while technology may affect nursing duties, it is not intended to be used to eliminate the Nurse’s role in the delivery of patient care."

https://www.crona.org/negotiations/