@lcamtufThere's a service you can run to intentionally trap them (nepenthes) or a AI blocker/anti-scraper (Anubis)
https://zadzmo.org/code/nepenthes/
https://github.com/TecharoHQ/anubis
Making web crawlers eat shit since 2023