This company is (of course) ignoring the robots.txt file placed on a server, and they're not implementing the user agent they *said* they'd use: https://docs.perplexity.ai/docs/perplexitybot
Currently, there appears to be no way to prevent Perplexity from scraping your website, despite their claims.
Fun company!
We strive to improve our service every day. To provide the best search experience, we need to collect data. We use web crawlers to gather information from the internet and index it for our search engine. You can identify our web crawler by its user agent User agent token: PerplexityBot Full user age...
More people were killed by U.S. law enforcement in 2023 than any other year in the past decade — and it's increasingly happening in small towns and rural areas.