Only like twenty years too late, but hey; The Internet Archive is going to stop honouring robots.txt https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/

Now if only the internet archive would let me fix the list of bugs I sent to the guy who runs it – it’s open source in much the same way as Android; you can get the source but good fuckin’ luck contributing meaningfully from outside

and also if only thirty years of internet history weren’t lost to time because people sniffed for particular user-agents

@ticky Let me tell you, you don't want to see some of the stuff going on under the hood in parts of the IA codebase. It's uh, messy.
@VamptVo I'm sure, but it's also got bugs I could trivially fix if they'd let me send a damn patch ¯\_(ツ)_/¯
@ticky We do have official volunteers who work at IA, I wonder if you could ask about that? I don't know how the process works exactly.
@VamptVo I don’t really see myself becoming an “official volunteer,” merely contributing ad-hoc, but there doesn’t seem to be an avenue for that
@ticky Yeah, I hear ya. I'll ask around at the office tomorrow though.