Headbanger MouseAlmost 29 million requests from AI crawlers defeated by essentially one simple check: if the user agent contains Chrome/ or Firefox/, and doesn't have sec-fetch-mode, it's going into the maze.
Billions of dollars poured into AI, yet, their crawlers are broken by two ifs in an nginx config.
If this all wasn't so sad, I'd laugh.
Post by iocaine powder, @[email protected]
#iocaine has been up for 4days 15h 5m 28s, and spent 1day 6h 26m 31s dealing with - *gestures hands wildly* - [everything](https://monitor.madhouse-project.o…
aburka 🫣