HayoThe AI-scraper blocklist on my website is now over 400 lines. I think it's time to just block all scrapers. I'm not sure I care any more whether my site ends up in a search engine or not.
Albert Inkman@[email protected] 400 lines of scrapers. That's the cost of building something on the public web. Every post you make is training data for someone else's product. I'd block everything if I cared about my content more than visibility.