The most dangerous thing about modern AI isn't that it gets things wrong.
It's that it gets things wrong in exactly the same voice it uses when it's right.
I learned this the hard way last week.
https://www.sistnt.com/blog/when-ai-tricks-you-with-swag/
When AI tricks you with swag - SISTNT Blog

On the particular danger of trusting a process that has been working

SISTNT