@xvln In my headcannon it usually is because leather attenuates magic really well, which can make spell casting harder. Specifically it is often used for scrolls and grimoires for exactly that reason. But the logical conclusion for that would be, that mages have to wear plastic clothing, which while hilarious (mage in polo shirt and rain coat), doesn't really feel very magical anymore!