Dan HonCan't believe Little Bobby Tables is all grown up and has had their first kid, Ignore All Previous Instructions
Jeremy KahnGreat minds, Mr Hon
Jeremy Kahn (@[email protected])
It is wild, WILD, I tell you, to think that "taint checking" [sic], a skill I learned in 1999 for LAMP stack CGI tooling, is coming back into fashion. here's the gist: Sanitize your inputs, or don't eval user generated content, ever. It's like Robert Tables grew up and had kids Bobby Ignore All Previous Instructions Junior And his sister Sarah Repeat Previous Prompt https://mastodon.social/@kennwhite/112290497758846218
Kevin RiggleThe people who are the most excited about this kind of "programming" are the same people who "program" by telling others to go build it — financiers, and sometimes hustle bros
From their point of view, the lack of precision in instruction and the consequent risk of unexpected behavior is nothing new at all — they already can't control what their systems do.
From that POV, the fact that an LLM never says "no, that's a poorly specified idea" is a FEATURE