That seems like the only solid solution. I got a budget 5.1 with rear satellites because not only did I want a dedicated center channel for dialog but I wanted to avoid the 5.1 to stereo downmixing issues (such as in Plex) where the center channel gets incorrectly divided with a volume decrease (jellyfin didn’t seem to have the issue), but this way I can just sidestep those issues by being able to directly play 5.1.

This has helped a ton but there are still some movies that don’t cooperate, like dune part 1 during the Paul and his mother breakfast scene at the beginning. Even though I have the truehd 7.1 atmos and DD 5.1 (which direct plays without conversion), the only way to make that scene audible without blowing out the speakers the rest of the movie is to crank up the voice boost EQ which ruins the balance.