I really can't overemphasize how destructive this is to the open web. The web is built just as much on a consensus on how to fairly do things as it is on technical measures keep things going, and AI scrapers have blown that up. https://go-to-hellman.blogspot.com/2025/03/ai-bots-are-destroying-open-access.html

I know Molly White wrote a passionate post recently asking people not to throw away open access just to stop AI scrapers, but many people *don't have a choice* anymore. If the old deal is broken, some people may be forced to take things private.

AI bots are destroying Open Access

There's a war going on on the Internet. AI companies with billions to burn are hard at work destroying the websites of libraries, archives, ...

@misty to paraphrase what I have said in another thread only a few minutes ago, ai has been in a vicious cycle for us, it is both flooding the web with useless data to have to filter out, and also being the only way to easily filter through all that data.

If the systems were not so damn trusting, maybe we'd have a better environment or something on here, but that is a very shallow estimation.