After too many attempts over the course of several days I finally got into the groove of the Soul Master's attacks and then he was not too hard to beat (I kept forgetting that I can dash...). So now I guess I'm going into Crystal Peak.
#HollowKnight