@dark_phoenix @ErikJonker @mcc once my gitea instance was literally ddosed by Meta, Anthropic and Huawei almost same time. Last even ignored robots.txt and changed UA strings often. All of those except probably Meta flooded from thousands of different address spaces. This brought down my experimental RISC-V server to unresponsive state multiple times. Two years earlier no such floods were there, my site was calm and still.
Later, after blocking them all, bingbot also went crazy mode around beginning of April, and I banned it too. It disobeyed any directives too. Waiting for Google to start hitting charts...
And I'm not alone.
https://arstechnica.com/ai/2025/03/devs-say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries/