It looks like whoever is behind this has finally come for one of my sites. Manually blocking datacenter IPs has worked for a while, but it seems like the traffic is now coming either from residential IPs, or the IPs are just getting spoofed.

Real conundrum. I didn't want to have to set up Cloudflare for the site, and I have to wonder how good they are at catching this anyway, but it might just come to that.

Anyone else has been dealing with this?

#indieweb #PersonalWebsite #devops #bots #spam #AICrawlers

New York passes bill forcing AI crawlers to identify themselves to news sites: New York's Assembly passed A11292 on June 5, 2026, requiring AI crawlers to disclose identity and purpose to news publishers or face $15,000-per-day penalties. https://ppc.land/new-york-passes-bill-forcing-ai-crawlers-to-identify-themselves-to-news-sites/ #NewYork #AICrawlers #DataPrivacy #TechNews #Legislation
New York passes bill forcing AI crawlers to identify themselves to news sites

New York's Assembly passed A11292 on June 5, 2026, requiring AI crawlers to disclose identity and purpose to news publishers or face $15,000-per-day penalties.

PPC Land
FYI: Kinsta adds free bot protection to all WordPress plans: Kinsta on June 9 launched Bot Protection for all plans, giving WordPress owners control over AI crawlers and automated traffic inside MyKinsta at no added cost. https://ppc.land/kinsta-adds-free-bot-protection-to-all-wordpress-plans/ #Kinsta #WordPress #BotProtection #AICrawlers #TechNews
Kinsta adds free bot protection to all WordPress plans

Kinsta on June 9 launched Bot Protection for all plans, giving WordPress owners control over AI crawlers and automated traffic inside MyKinsta at no added cost.

PPC Land
@kaffeeringe das hatte ich auch schon, ebenfalls der Hinweis, per htaccess einfach gewisse/die meisten IP Netze zu sperren.
Was ich aber nicht verstehe: wenn so ein KI Bot eine Website "abgrast" sollte das doch mit einem Aufruf pro Seite erledigt sein. Wozu müssen die das 10.000e Male machen? Oder ist diese Technik des Einlesens einfach genauso schlecht und unausgereift, wie die Ausgaben?
#KIBot #KICrawler #AIBot #AICrawler #AICrawlers #AI

Attaque crawlers IA en cours sur le serveur gayfr.online : 98% des challenges #Anubis sont rejetés (donc sont des bots), plus de 800 000 requêtes sur la semaine.

Du coup aucun impact sur les performances ni la disponibilité. Il reste juste un bot vietnamien malin qui passe sous les radars et interroge le service RSS avec plusieurs secondes ou minutes d'intervalle. Pas gênant mais je lui réglerai son compte.

#gayfr #IA #AI #ArtificialIntelligence #IntelligenceArtificielle #AICrawlers #AIBots

Gibt es einen Trick, um fail2ban beizubiegen, daß es Hosts bannen soll, die vor dem Abgreifen von, sagen wir, JPGs, nichts anderes von der Site geholt haben?

#fail2ban #aicrawlers

🇬🇧 Protect Mastodon against AI bots with Anubis

I wrote a complete guide for Fediverse admins on how to protect against AI bots: https://blogs.gayfr.social/barbapulpe/protect-mastodon-against-ai-bots-with-anubis

To protect our users and our servers against those rogue robots.

Please boost!

#IA #AI #AICrawlers #AIBots #Anubis #Mastodon #MastoAdmin #MastodonAdmin #ArtificialIntelligence #IntelligenceArtificielle

Protect Mastodon against AI bots with Anubis

Cet article en anglais est également disponible en français ici. Introduction In a previous article in French, I explained my motivatio...

Techno-Fil et faits divers

🇫🇷 Protéger Mastodon contre les bots IA avec Anubis

J'ai écrit un guide complet pour les administrateurs du fédiverse sur comment se protéger contre les bots IA : https://blogs.gayfr.social/barbapulpe/proteger-mastodon-contre-les-bots-ia-avec-anubis

Pour protéger nos utilisateurs et nos serveurs contre ces robots voyous.

N'hésitez pas à faire tourner !

#IA #AI #AICrawlers #AIBots #Anubis #Mastodon #MastoAdmin #MastodonAdmin #ArtificialIntelligence #IntelligenceArtificielle

Protéger Mastodon contre les bots IA avec Anubis

This article in French is also available in English here. Introduction Dans un précédent article, j’expliquais mes motivations et choix...

Techno-Fil et faits divers

Guests on our own web

A few months ago I spun up a new VPS on Linode, London datacentre. Nothing special – Debian, Nginx, a Let's Encrypt certificate, a domain I was going to use for my daily notes and my homelab experiments. No link posted anywhere, no entries in my feeds, no backlinks from the sites I run. Just a freshly assigned IP, from a subnet that a week earlier had belonged to someone else.

[...]

https://write.as/jolek78/guests-on-our-own-web

Guests on our own web

A few months ago I spun up a new VPS on Linode, London datacentre. Nothing special - Debian, Nginx, a Let's Encrypt certificate, a domain...

jolek78's blog

C'est assez rigolo, les bots IA se calment le week-end, on passe de >90% en semaine à 70% "seulement" en fin de semaine...

#gayfr #IA #AI #AIBots #AICrawlers