Jan 🐢Jul 8
404 Media

The Open-Source Software Saving the Internet From AI Bot Scrapers

🔗 https://www.404media.co/the-open-source-software-saving-the-internet-from-ai-bot-scrapers/

The Open-Source Software Saving the Internet From AI Bot Scrapers

Anubis, which block AI scrapers from scraping websites to death, has been downloaded almost 200,000 times.

404 Media
Jul 7 at 8:54pmBuffer
Show threadMr Intergalactic KeyboardJul 7
@404mediaco info from the dev: https://xeiaso.net/talks/2025/bsdcan-anubis/
I fight bots in my free time

I made Anubis, a lightweight, open-source Web Application Firewall designed to block automated bot attacks without frustrating real users. Anubis uses techniques like TLS fingerprinting and JavaScript proof of work to keep your site safe while staying flexible, fast, and easy to deploy.

Show threadROTOPE~1 Jul 7
@404mediaco love how the RMS fanclub comes to the brainlord conclusion that Anubis is the single greatest cancer on the internets.
Show threadratfactorJul 7

@404mediaco

> Iaso, who said she deals with some generative AI at her day job, told me that “from what I have learned, poisoning datasets doesn't work. It makes you feel good, but it ends up using more compute than you end up saving. I don't know the polite way to say this, but if you piss in an ocean, the ocean does not turn into piss.”

This quote convinced me, alas, to scratch off making a piss-maze for ratfactor.com from my TODO list.

Show threadGrumpy Old Techie 🕊️Jul 8
@ratfactor @404mediaco But if everybody pisses and shits in the ocean it becomes a problem rather quickly
Show threadTommi 🤯Jul 8
@404mediaco There are discussione going on @yunohost’s forum on how #Anubis can be used in it, but it looks like a lot of work 😩