olivierlacanAug 7, 2023

Speaking of which, hot new robots.txt entry just dropped:

User-agent: GPTBot
Disallow: /

https://platform.openai.com/docs/gptbot

OpenAI Platform

Explore developer resources, tutorials, API docs, and dynamic examples to get the most out of OpenAI's platform.

Show threadPatrick $8 
@olivierlacan Would be a shame if a bunch of websites responded to this user agent with megabytes of nonsensical English text. That might screw up its model
Aug 7, 2023 at 7:20pmWeb