@johnmu Hey John - we had this weird one, we saw a period where the robots.txt (and other files) were not fetchable. But the response we were getting was "Not Fetched - N/A". Can you help us understand what that means? The docs don't have this error type (https://support.google.com/webmasters/answer/6062598?hl=en&authuser=1#check-status:~:text=See%20your%20robots.txt%20files%20and%20crawl%20status)
AFAIK (Unless the UA/IP range was being flagged as a bad actor by CDN) these pages were fetchable to all at the time (we've checked the logs!)




