nixCraft 🐧Sep 29, 2023
Add OpenAI, Google, and Common Crawl to your robots.txt to block generative AI from stealing content and profiting from it. See https://www.cyberciti.biz/web-developer/block-openai-bard-bing-ai-crawler-bots-using-robots-txt-file/ for more info and a firewall to block those and other AI bots, too. #AI
Show threadRaj 🇬🇧🇪🇺💻🖥(🌻🇺🇦;🇵🇸)

@nixCraft The thing is, people call this "blocking". It isn't. There is absolutely no guarantee that specifying a restriction means it will be honoured.

It's like leaving your front door wide open but pinning up a notice that burglars should not enter the house, or specifying which drawers they should not rifle through.

If you want to be assured of a block, then BLOCK it. WAF it. Boot them out on their ear if they even come looking.

Sep 30, 2023 at 7:34pmWeb