Speaking for myself only, I've used mineral spirits on 100s of occasions, it's perfectly safe. Like everything else in life too much of anything can be a negative. Use sparingly, allow area to breath and dry. If rub too hard you may get a blemish, that's why there Novos #2 polish.
Finally and most importantly, as DOs we always state "The accuracy of your armor is ultimately up to you the wearer".