My psychiatrist and I have spoken at length about how my triggers (drinking and sedatives) have far more to do with self-medicating anxiety than wanting to "party."
If possible, it might be a good idea to see a psychiatrist for medical treatment for your anxiety, preferably one that also has experience with substance abuse.