Do you have a sponsor? If not, maybe call the AA helpline and ask if a recovered member could come and visit for a chat about your difficulties. I was too frightened to go to meetings cold, and it helped me a lot to have one person I knew, who understood me, and who took me/met me at my first meetings. They looked after me until I found my feet.
What you describe can be a real problem. I knew a chap, met him in my stay in the loony-bin who simply was too fearful to mix with others. Even drinking didn't help him, he just locked himself away in his house with his booze, and wouldn't answer the door to even his few friends. The last time I saw him was through a window of his house as he tried to sneak, unseen, from one room to the next. He never recovered.
It is a great shame he couldn't get over the anxiety, even to the point of getting some help for it specifically. And he was the nicest man you could wish to meet.