AAAHHH!!! no, no sand paper. lol
You're going to laugh but use white glue or Aquanet hair spray (or similar) to dull out the areas, then weather that. Trust me, once you scuff up there's no going back. Try the glue or hairspray, if you don't like something you can wash it off and start over. Just a trick I learned with mt TD.