Damn. The AI war is getting heated https://xcancel.com/eastdakota/status/1952379571527193017 All AI companies ignores robots.txt and any other block you put are also ignored. Without your your private data their AI can't answer back anything. They are stealing from everyone. It is simple as that.

EDIT: Original blog post https://blog.cloudflare.com/perplexity-is-using-stealth-undeclared-crawlers-to-evade-website-no-crawl-directives/

Part of the job as a cybersecurity professional is in fact arguing to purge and not log information about your customers.

Data is not oil. It's risk.