Anxiety from alcohol withdrawal is very common. Alcohol withdrawal can last several days, fortunately, you are past the danger zone.
Drugs can affect us all differently. I personally get awful rebound anxiety from even a couple of small doses of benzos. Perhaps it is that!
Congratulations on 4 days, that is wonderful.