Add the Displayport! Which doesn’t even allow hot-swapping, I keep needing to turn my computer off…
I’ve never had this issue, could be a driver thing, but it’s not common.