I had the wrong ESD diodes and crystals for this design and couldn't wait for them to arrive.
Also I switched the USB pins on the STM32.

This board contains three bodges and a lot of flux, but USB enumerates 😅