@eric I hadn't considered AI for accessibility before... It may plug an unfortunate gap I've seen, which is that developers really, really, really don't want to support a11y in most firms and management doesn't care enough to force the issue.
But if an LLM can reduce the problem of identifying issues to one analysis pass... That's not a small thing. And I'm generally seeing LLMs are better at that than traditional heuristic approaches, because they end up trained on real-world examples of what goes wrong.
@eric @mark #Facts The amount of manual effort to get AI to do what everyone thinks it can do is severely understated. And even after all the setup, my experience was that it did not accelerate anything. Output was barely equal, but mostly lagging behind humans. (yes, this was actually measured)
And the reality is, thats "ok?" if everyone agrees and understands the effort and output. It's not magic. It's more artificial than it is intelligent. It's definitely not cheaper.
@eric The approach I've seen work best is AI as an automated reviewer in the pull request workflow. It can false positive and false negative, but in practice the false-pos rate I'm seeing is like 1-5% (and much of that corner case stuff, like "yes you're right but that is autogen code that cannot be fixed at this layer").
It needs human in the loop, but it doesn't get bored in the same way humans do.
This effort is being dogfooded, 100% LLM-forward with its approach. Because of this, I also need to vibe code in order to contribute.
I'm sorry, am I misreading or do they actually force the real, code-literate engineers to use the stupid dream machine rather than their own actual knowledge? To design a thing that's user facing? Good grief?
@eric
< I am being structurally compelled to work this way, and also tracked and ranked based on my frequency and volume of token use.
Yikes. Starting to think getting sacked was the best thing for me.
Okay I'll stop now.
@eric Great writeup. I also carry a lot of cognitive dissonance when using AI for development work. I don’t really know what to do with the feelings and feel a bit stuck.
At the same time I was recently able to make a macOS accessibility tool that me and a handful of people have been using daily and it’s made things so much easier for us. It probably would have never existed without the LLMs.