It'll stop when you get your self-esteem from internal and not from external sources. The more I grow, the less I care what other people think of me. I'm still working on this, though. Just the other day my doctor helped me see that I give away my power by letting what other people think of me effect how I think about myself. It should only matter what *I* think of me.
Sensitivity can be a good thing. It doesn't always mean "thin skinned". It can mean you're in tune to and care about other people's feelings.