Just so we're clear: I include #Matrix direct messaging link in format of https://matrix.to/#/@vintprox:envs.net 👌...which #YouTube has no trouble with. The reason I even publish DM link instead of my #MatrixSpace, though, is because YouTube has a meltdown from links containing a second # (number sign, replace @ with it to get into my space).
From technical POV, it's one correct #RegularExpression away for YouTube, as many modern social media and video platforms can handle it and do use normal #regex. But, on the other hand, #MatrixTo service just shouldn't be employing such flawed #URL pattern or provide an alternative one, even if #URI standard allows the former to exist.
So, yeah, there is that - it is hard to gather video viewers in such a place. It's a single thing that I miss from Discord invite links. Matrix ones don't need a vanity and it's sweet - one solution is put it through #URLShortner, but then the entire point is lost.