Set up a navidrome service and stream your library? I use Symphonium on android, works quite nicely but it is paid. There’s a bunch of free apps that also work with navidrome, as well.

but i have my library on my phone, why stream it?

So you don’t have to rescan every time?