I’m Losing All Trust in the AI Industry

As a supporter, I would love not to feel this way

The Algorithmic Bridge
@wohali for those who don't want to give Substack the traffic https://archive.is/ITkpj
@wohali "A disturbing amount of effort goes into making AI tools engaging rather than useful or productive.
I don't think this is an intentional design decision."
oh, honey
@wohali
Thanks for this. Essentially it boils down to: "There are some tools that are potentially useful but their development is neglected because the companies and developers are making big money promising investors they can have unicorns tomorrow and putting about wild stories to make that promise plausible. In the meantime we are left with Microsoft Clippy's bigger, more actively unreliable cousin and tools for creating interactive pictures of girls with unfeasibly large breasts and seven fingers and it's the latter that will get the work done on it because it generates more clicks and income."
@wohali most infuriating clown skit

@wohali “How did it happen? OpenAI can’t tell you. How can it be prevented? OpenAI can’t tell you. Because OpenAI doesn’t know. No one does. AI models behave weirdly, and as weird as their behavior is, their misbehavior is weirder. When you manage to jailbreak a model or someone else prompt-injects it, what happens next is unpredictable. If anyone can lure ChatGPT into roleplaying something it shouldn’t, then it is inherently not a safe product.”

This is an incredibly fatal flaw which means you totally cannot use LLMs for most, if not all, professional applications without exposing yourself to incredible risks that even the dullest human’s common sense would recognize.