You have to take it for what it is.

If you have a good looking piece and someone finds out and spreads rumors it just makes THEM look insecure. I had one guy who was very jealous of me do this in the beginning. He wasn't very happy that I seemed to be getting with all of the women he was interested in, so he decided to be a jackass and tell everyone.

It's really all in how YOU look at it. If you project shame it just fuels the fire. if you project confidence they have nothing.