I'm sorry you are feeling that way. Those feelings suck. I know them too well. My husband and I were once very social - going to and hosting lots of parties. Two years ago we had to move for my husband's job to a new state. I have tread very carefully on my social life here, as I felt the parties were a big trigger to my over-drinking. I don't miss the very active social life nearly as much as I thought I would. I get pangs every once in a while, but I feel like I have more freedom and less expectations and that feels good. Bottom line is, I have weighed in on how I spend my time. I am more conscious about my choices and I am honest with myself of what is really important to me and not so much as to what I think should be important to me.
Everything I have read here has said that those anxiety feelings will pass, so you are going to be just fine no matter how you proceed with your social life.