This will never stop happening.

The fundamental prerequisites of security are systems that can be understood being operated by people who understand them.

Large Language Madlib Sycophancy does not and cannot have either of those properties.

https://mastodon.social/@arstechnica/116759521376879012

@mhoye well no, I mean it didn't stop happening when humans built code, and since AI only uses what's gone before I don't see why it would.

@mhoye this is a tangent, but only a slight one:

also, the number of people that went from
"there are no silver bullets"
to
"my vulcan cannon fires depleted silver rounds"
is fucking staggering 😛

@eigen @mhoye It'll be like the clusterfuck that is smart contracts, but for everything.