It would be most helpful and really actually necessary to give up the alcohol to allow the medication to work so that you know what your true situation is.
You MUST be very cautious mixing the two, because yes, it can be a disaster.
If you find that you are taking more than prescribed ask about a non-narcotic for anxiety.
I take xanax, but I have definitely found less is better.