Mastodawn

Introducing pay per crawl: Enabling content owners to charge AI crawlers for access

https://piefed.world/c/webdev/p/855670/introducing-pay-per-crawl-enabling-content-owners-to-charge-ai-crawlers-for-access

Introducing pay per crawl: Enabling content owners to charge AI crawlers for access

> Pay per crawl is a new feature to allow content creators to charge AI crawlers for access to their content. > Pay per crawl grants domain ow…

Show thread

cockmushroom Feb 9

what if youlre not trying to train ai? What if you just want to update a personal dashboard/archive?

Show thread

Hippy

Well, cockmushroom, then you’re building a pretty expensive dashboard. I still don’t see how they are going to differentiate between normal browsing and bot crawling. I don’t think that’s an exact science.