Sounds pretty important to go. I know I have isolated and felt I could handle it but when I don't have contact with people I can't work stuff out, don't bounce it around. One of my greatest fears has been other people and what they think of me, second guessing things that I say in case they are not quite right, overly worrying about how I fit in. When I realised that other people are usually more interested in themselves than me or if they are interested in me it is to share or help each other, this fear passed a bit, then some more. Anyone who is going to tear me down in some way has more problems than me and anyone who is going to help me must want to do it.
People are ok, they are just like you, same fears etc. We are all just at different stages. But you can't see all that if you don't get to meetings and stuff, so I reckon you should just make yourself go.
You can do it!