Introducing WebAccessBench, a novel benchmark for AI language models to assess #accessibility quality and WCAG conformance in generated web interfaces under realistic prompting conditions.

I did a bit of research and found that LLMs are incredibly bad at basic digital accessibility tasks. You can compare models and read the full white paper at https://conesible.de/wab.

Overall data suggests massive implications for society at large, and major discrimination of people with disabilities. #a11y

@kc Thank you Casey, for backing up my previously only "intuitive" assessment with hard facts.

I have already shared the link to the whitepaper several times today at work and I am looking forward to seeing the sample examples, as I am still rather a noob when it comes to prompting 😉

@ellianoa The sample prompt set is included in the white paper now 💚