To say something so hurtful is a reflection on him and his lack of feeling - not you!!
I think friends aren't easy to come by and it's because of that they are valuable. I can imagine with kids and work it's difficult to find time to socialise.
But I think you should judge yourself just by your own behaviour not by the rudeness of your husband.
I think the world of my hubby but all of our 'active' friends are through me - no matter what, no matter how tempted, I would never throw that at him. There are things which as human beings we all should recognise as to hurtful to use in a row!! BTW - I don't think he's any less of a good person or good friend than me just because I have more friends, life ain't that simple!