Spotify does this too if I recall.
Firefox has a plugin called ClearURLs that cleans URLs across the entire web, not just YouTube. Might be available on Chrome too.