Caffeine will wreak havoc on your blood sugar levels, first by making your body release adrenaline, and then with the ensuing "crash" once it wears off. I had the same problem, because alcohol is a "quick fix" for both a drop in blood sugar as well as anxiety. You may want to lay off the caffeine for a while, until you get some distance between the last drink.
Trust me, I know, because I drink espresso non-stop. Having a double espresso now, actually. You mentioned Yerba Mate, which I also drink, and it is much better for you than coffee. It has caffeine, but it has other things as well which counteract the anxiety somewhat. Yerba Mate can be brewed like tea, but I drink it old school out of a gourd.