Elena Rossini ⁂Mar 17

Yesterday my VPS set off a warning, as it was hit by a huge spike in incoming traffic, peaking at 55GB at 2:15pm and lasting for an hour.

Upon investigating, it turns out it was my PeerTube instance that was targeted.

Where did the traffic come from?

meta-externalagent (aka Meta's web crawler which is used to grab content to train its AI system).

I feel a little bit violated thinking my Fediverse promo video was grabbed by it, sigh.

#AIcritic #NoAI

Show threadMitex LeoMar 17
@_elena I was forced to take down my SearXNG instance because of these stupid bots.
Show threadAndy PiperMar 17
@ml @_elena I have mine behind Aurelia so only I can use my own searXNG
Show threadKATastrophEMar 17
@andypiper @ml @_elena my searxng has been fine so far (at least to my knowledge), but thanks for the heads up, i should really put it behind my sso!
Show threadMitex Leo
@kate @andypiper @_elena I was running a public instance. Also didn't use Cloudflare as requested by some users.
Mar 17 at 9:53pmWeb
Show threadKATastrophEMar 17
@ml @andypiper @_elena mine is public and i also don't use cloudflare (just my own vps with wireguard for tunneling the traffic)