Chris's Wiki :: blog/web/WebScrapingItsNotJustLoad

@ArchiveTeam What's with the 33,000 hits on my personal site? And myriads on our others? Can you not hit things at this rate please? This is worse than Google or Baidu. #ArchiveBot
I donʼt know whoʼs running the #ArchiveTeam #ArchiveBot, but you just donʼt load someoneʼs server like that. Loads multiples greater than Googlebot and Baidu. Not the first dodgy scraper found on Github, and I canʼt trust that people arenʼt using them as theftbots.