I would not let it bother you but I would be honest with myself. I have found when things hurt me that usually there is some truth to them. I would also look at the source. Do the people in question seem to have long-term good sobriety?
This is the kind of thing I would ask my sponsor or at the very least someone that I'm comfortable with the program. I simply am not a good judge of me.