Dave RahardjaI’ve set up Cloudflare to set robots.txt to deny access to my blog site for most AI crawlers, but I see ByteDance’s Bytespider disregarding it.
john fink ok!! :goat:@drahardja god, bytedance is the worst.
I’ve set up Cloudflare to set robots.txt to deny access to my blog site for most AI crawlers, but I see ByteDance’s Bytespider disregarding it.