It took a week, but I solved the YouTube Music skipping issue, turns out I enabled a bunch of Bluetooth plugins and one such plugin was responsible for transferring data (file transfers).
Once I disabled that plugin, YouTube Music has been working flawlessly.