olivierlacanAug 7, 2023

Speaking of which, hot new robots.txt entry just dropped:

User-agent: GPTBot
Disallow: /

https://platform.openai.com/docs/gptbot

OpenAI Platform

Explore developer resources, tutorials, API docs, and dynamic examples to get the most out of OpenAI's platform.

Show threadTatsu
@olivierlacan unfortunate that this even has to happen 😞 it'd be nice if website just weren't scraped for AI training or it was on a very opt-in basis.
Aug 8, 2023 at 1:00amWeb