pablolarahSep 26, 2024

🤖 ai.robots.txt

by Cory Dransfeldt

@cory

This is an open list of web crawlers associated with AI companies and the training of LLMs to block.

#BlockAI #BlockWebAIwebcrawlers

https://github.com/ai-robots-txt/ai.robots.txt

GitHub - ai-robots-txt/ai.robots.txt: A list of AI agents and robots to block.

A list of AI agents and robots to block. Contribute to ai-robots-txt/ai.robots.txt development by creating an account on GitHub.

GitHub