OpenAI's crawler just found our family server / cloud services and immediately proceeded to crash Nextcloud within minutes. Fucking fantastic.

Is there some nice, up-to-date write-up on the different tools to protect yourself against this?
#AI #AISlop #AttackOfTheMachines #selfHosting

@Natanox I can't recommend, but will someone please comment with things to look out for?

Obviously, I can look for average traffic off the chart, but does the creepy-crawler traffic come from one IP address, or a narrow range? Does it deliberately ignore robots.txt ? These things could trigger a goooo_sloooow, or return a "Go stick your head in a pig" page, or something.