Scientific Advice MechanismMar 3

The Scientific Advice Mechanism recently held a webinar asking: “How far should we trust AI in a crisis situation?” What made this webinar particularly valuable was the diversity of perspectives, all converging on one message: the question is not whether AI has potential in crisis management, but whether we have the governance, the data quality, and the institutional readiness to use it responsibly.

Watch the full webinar: https://scadv.eu/Le77prq
Read our full article: https://scadv.eu/MdexcSf

Show threadScientific Advice MechanismMar 3
Prof. Tina Comes described a "Goldilocks dilemma": too little trust in AI means useful tools go unused, but too much trust can lead to dangerous autopilot behaviour, especially under the stress of an emergency. The challenge is finding the right balance, depending on the type of AI and the stakes involved.
Show threadScientific Advice MechanismMar 3
Prof. Andrej Zwitter walked through the EU AI Act and showed that while the regulatory framework provides some clarity, significant grey zones remain, particularly around accountability and the fact that most large AI models are developed outside Europe.
Show threadScientific Advice MechanismMar 3
Dr. Olya Kudina drew on the COVID-19 pandemic to illustrate how a crisis accelerates AI adoption, often at the expense of proper validation. Over 700 diagnostic AI models were developed in early 2020 alone, many without robust testing. Contact tracing apps failed not because the technology was flawed, but because governments communicated poorly, and public trust eroded.
Show threadScientific Advice Mechanism
Commandant Quentin Brot offered a practitioner's perspective from the French firefighting services: AI works well for wildfire detection and logistics planning, but operational chatbots that advise firefighters during emergencies are, in his words, "highly dangerous." Nothing replaces human judgment, empathy, and courage on the ground.
Mar 3 at 9:41amBuffer
Show threadScientific Advice MechanismMar 3
Prof. Rémy Slama, speaking for the Group of Chief Scientific Advisors (GCSA) of the European Commission, argued for sovereign European AI tools and urged caution: AI should not currently be used for any decision in a crisis. Humans must remain at the centre. And investment in crisis prevention and preparedness is essential. Access the reports: https://scadv.eu/0vB7fjq