Does anyone know how to get this dialog to go away (“OK" just presents it again)?

Better yet, how do I prevent it from occurring in the first place?

It happens every couple of days and I can't TestFlight my own app without restarting my Mac.

@chockenberry unfortunately not. I gave up and stopped using the TestFlight version on Mac.