You would be surprised at just how little attention people pay to things like this. If you are worried about it, wear the hat for awhile off and on even after you get your hair looking the way you want it. Another trick that can help throw people off is to change it up with a bandana. That way it starts to give a peek of your hair but it's less dramatic of a transition.