PwnallthethingsSo these AI chats are pretty cool.
One thing that's gonna cause some problems tho is that they sound really really convincing while sometimes being extremely extremely wrong
A zillion ways this revolution is going to be great.
One way that's going to suck tho is in places where human interactions are a *useful* friction / proof-of-work. When it's not, those systems will get really overloaded
Few examples:
1. Online troll bots & fake personalities
It's going to get a *lot* harder to distinguish bots from people and much easier to create entirely fictitious credible online personalities to troll/harass/do crime
2. Persuasive letters by e.g. constituents to regulators.
Volume of (~sensible, unique) letters was a valid indication of sentiment. Soon won't be.
3. Ransomware victim communications & negotiations
Used to be one of the few costly areas in scale. Not for long
4. Places where writing is assessed for cash or credit
Going to be much easier for e.g. students to fake/plagiarize essays or other homework for-credit
Combatting that will probably eventually force schools and universities towards towards more heavy focus on proctored work (exams, supervised essay writing) (ugh)
Going to be much easier to create fake-news clickbait farms too for ~ the same reason
What worries me a bit here is that in trying to preserve some of these systems, there'll probably be a lot of folks pushing tech designed to *prove* humanness to combat it. And politicos and regulators are less likely to hear that and think "guess they should use creative CAPTCHAs" and more likely to think "oh, people should upload passports", and that's gonna be a whole new shitshow
Also excited for the new era of "who is liable when the AI tells you to cook the frozen Turkey in the deep-fryer" / "can you maliciously interact as user A with the AI, such that the AI interacts with user B and advises them to do X" wars
Anyway. New world. New cool stuff. New unforeseen challenges. Gonna be weird.
Gonna add one point to this, since it's easy to focus on the downsides. There's some great stuff too.
One way AI is going to be *fantastic* is for accessibility. Imagine, for example, tools that summarize pictures as the default text for alt-text fields, making it faster and easier to make apps and sites accessible by default.
Another is making cool learning technologies, especially for beginners. Turning text into example code and vice-versa is a great learning tool!
🦄 Vlt (Cédric Hebert) 🇫🇷@Pwnallthethings The training aspect is great, let's see where this will go. The AI created a CTF challenge and it's write-up upon my request, but the answer came with a "this request might violate our code of conduct".
I hope infosec learning won't be sacrificed in the name of security!
I hope infosec learning won't be sacrificed in the name of security!