It looks like there is yet another AI scraper on the loose. Their user-agent links itself to a repository on github that has only a readme.md, and a webmasters.txt on it.
Their description of the bot is vague to say the least.
They hit my selfhosted website, and the forum of my main website boykisser.nl. But they only made 2 requests, one of which is robots.txt with a generic go-http-client.
their website has the .ai TLD which rings all my alarm bells.
They say they respect robots.txt. But i have to see this, but i think i have to resort to a User-Agent block soon
The user-agent string is: "TerraCotta https://github.com/CeramicTeam/CeramicTerracotta" if someone wants to grep their serverlogs.
#webmaster #webmasters #ai #aislop #scrapers