Is SD card a hard requirement? Did you try internal storage and did that fix the problem?

A “music player” here plays twp roles: filesystem handling and audio playback. Have you considered dividing the jobs to multiple applications? For example, get a playlist manager, and have it call the music player with “next track” in order.