Cloudflare will now block AI crawlers by default

Cloudflare has announced that it will now block AI web crawlers by default for new customers. It’s also introducing a new “Pay Per Crawl” fee that will let some publishers make AI companies pay to scrape their content.