@pwithnall IntelliJ IDEA / Pycharm Community is open source and can do this. You can load all the open MRs, and even checkout each MR. I think you could create comments and then submit them once going online.