Viktor Pankraz

RE: https://mastodon.social/@dansup/116699331710256209

And somehow I missed this. It seems to be better now indeed!

Jun 7 at 9:01pmWeb
Show threadAlexander S. Kunz5d ago
@ViP not because of some directives in robots.txt…
Show threadViktor Pankraz5d ago
@alexskunz I have no idea. I just noticed the improvements. In the thread someone gave another hint. And even then 🤷🏻‍♂️
Show threadAlexander S. Kunz5d ago

@ViP yes, I saw that, and while using .htaccess rules is a little better, the assumption that those "AI" crawlers can be matched to a user-agent string and then blocked via .htaccess is not going to work either.

Unless one would want to block everything that is "Chrome/*.0.0.0" of course... (that's what the vast majority of stealthy AI thieves are using, from behind residential proxies, see https://www.alex-kunz.com/bot-checks-are-a-nuisance-but-whats-the-alternative/)

Bot-Checks Are a Nuisance (But What’s the Alternative?)

Clearing up a couple of things about “bot checks”. Who you should be mad at, why you’re seeing them — and why we’re most likely only going to see more of them.

Alexander S. Kunz Photography