@noahcarver The option to indiscriminately show all tray icons at all times has been removed in Windows 11. Your options are to either:
1. Go to Settings -> Personalization -> Taskbar, expand the "Other System Tray Icons" section, and toggle on the icons you want to be persistently present. The downside of this is that you'll have to revisit this area of settings every time something new is added to your tray (e.g. because you installed a new app) and Windows decides to hide it.
2. Install an app to completely restore the old tray behaviour, such as ExplorerPatcher. The downside of this is that it is unsupported by Microsoft, and does stop working from time to time (e.g. after a big Windows update). Get it from: https://github.com/valinet/ExplorerPatcher/releases