I wanted to do the same for a dedicated jellyfin player box; a defunct laptop or mini PC that boots straight into the jellyfin-media-player (jellyfin desktop nowadays) in TV mode and was looking for just the bare minimum of packages to achieve this. gave up, curious how others solved it.

Weston can be configured to use a kiosk shell, which is fairly minimal