It's very entertaining seeing bots hitting robots.txt and being declined, I'm assuming the scraping is being nicely repelled so far from the MansionNET git :)
It's very entertaining seeing bots hitting robots.txt and being declined, I'm assuming the scraping is being nicely repelled so far from the MansionNET git :)