I have been trying for hours to debug what I thought was a #Treafik regression causing massive CPU usage to the point that my own (very small) dockerized services I host for my family are getting slow and hard to reach.
But no, my meager virtual server is just being DDoSed by stupid #AI bots downloading pieces of my webpage over and over and over again. It looks like the steps described in https://www.mayrhofer.eu.org/post/defenses-against-abusive-ai-scrapers/ are no longer working, and I need to start looking into actual IP blocking. However, as AI fraudsters are resorting to using massive client pools for downloading, that will also become difficult.
This is new. The AI scraper bots amounting to over 90% of all traffic until a couple of weeks ago were annoying, but my services still worked. Now it has reached the level of active denial of service.