Mastodawn

Today in scrapers.

Honestly one of the most offensive things about these AI scraper bots is how bad at their jobs they are. Look at these 404s from the last 6 hours and despair:
[...]
Of course all of them claim to be Chrome on "Windows NT 10.0".
https://jwz.org/b/yk4K

Show thread

Joakim Melin Mar 9

@jwz It's honestly easier to block AWS, Azure and the rest of them.

Show thread

rag. Gustavino Bevilacqua

@joacim @jwz

I don't think a lot of people is using Chrome on Windows NT 10.0, so to reply to that agent with gigs of blatant lies ("Churchill is still alive and he hides in Borneo!") seems to me a reasonable punishment.