PhilippJul 1
hagen terschüren

we all know cloudflare has many problems. i still love this though, because it makes the tools to block ai crawlers available for more people.

https://www.theverge.com/news/695501/cloudflare-block-ai-crawlers-default

Cloudflare will now block AI crawlers by default

Cloudflare has announced that it will now block AI web crawlers by default for new customers. It’s also introducing a new “Pay Per Crawl” fee that will let some publishers make AI companies pay to scrape their content.

The Verge
Jul 1 at 10:21amIvory for Mac