Nelson4d ago

@algernon Are there any defenses against LLM scrapers that you would consider deploying alongside iocaine, or do you think it functions best alone? Like are there complementary approaches?

#iocaine

Show threadAmanda G in Éirinn
@skyfaller @algernon If I’m not mistaken Anubis works at the proxy layer, but I have not myself implemented it so take that suggestion with a grain of salt. https://dukespace.lib.duke.edu/items/a99a4736-6542-4ef1-8492-41c80e58e1be
Anubis Pilot Project Report - June 2025

In May & June 2025, Duke University Libraries (DUL) staff successfully implemented Anubis, a configurable open source web application firewall (WAF), in order to stave off persistent onslaughts of AI-related bot scraping activity. During this pilot period (May 1 - June 10, 2025), aggressive bot scraping led to extended outages for three critical library platforms (Duke Digital Repository, Archives & Manuscripts, and the Books & Media Catalog), and in each case, implementing Anubis mitigated the problem.

Mar 25 at 10:58amWeb
Show threadNelson3d ago
@amanda @algernon Sadly the Anubis author is a self-described "centrist" on LLMs, uses them to write code and as a conversation partner, so I don't really trust Anubis long-term. I want to post about it but they are sick and I'm sick so now is not the time to pick a fight with a mutual.