Huh, really seems like Adafruit intentionally doesn't include reverse polarity protection on the battery port of their feathers...

This is literally 1 FET