Have you purchased RJ45 dust covers? I've tried some, but they seem so loose, they fall out of the switch fair too easily. They are a harder type of plastic. I'd guess that something softer and slightly snugger would work better.
@dvl I've once used AMPCOM RJ45 plugs from aliexpress which were quite good. But we still have hundreds of unshielded RJ45 crimping plugs from "ye olde days" at work, where the inserts are long missing, so I usually just use those to block off unused switchports or protect console ports from accidentally plugging in an ethernet cable.