Natanox 🇺🇦🇵🇸1d ago

OpenAI's crawler just found our family server / cloud services and immediately proceeded to crash Nextcloud within minutes. Fucking fantastic.

Is there some nice, up-to-date write-up on the different tools to protect yourself against this?
#AI #AISlop #AttackOfTheMachines #selfHosting

Show thread"Musty Bits" McGee
@Natanox I don't know of a write up comparison. There's AI.robots.txt which will give yih a list of user agents to block and a robots.txt - for what it's worth. I hear they're just solving js challenges now so not sure Anubis will cut it. Iocaine I'm running and it seems good, have had meta and now claude stuck in the tarpit for a week plus but then again it seems like nowhere near ddos levels others have gotten
Mar 28 at 9:53amWeb
Show thread"Musty Bits" McGee1d ago
@Natanox oh yea the ddos tier stuff people have had substantial servers overwhelmed so dropping traffic in the network stack might be required - iirc they usually look for the ASN of the company and add a rule for that. Idk if anyone has wired up layer 7 detection to fail2ban yet
Show threadluna the doggie  1d ago
@arichtman @Natanox it doesn't matter if they solve a POW challenge, the point is slowing them down and making it expensive, much like captchas