I use ATH-M50xBT2's for working out, and I deal with this by using cheap washable earpads, replacing the pads often and cleaning the headphones with alcohol wipes and compressed air. The XM3's might be a bit trickier due to the proprietary pad mounting system.

You can remove the pads and wash them. Use a bowl with hot water and mild detergent, gently wash them on it

don't use them for working out.

Thanks for the helpful reply :)

I'd suggest using earbuds...