Welcome to SR. I'm about your age and I think that drinking had a lot to do with my anxiety. I have been sober about 70 days and feel pretty good about things. I'm still a worry wart and have to talk myself out of being anxious sometimes but I don't feel those uncontrollable feelings like all jittery and racing thoughts etc. I think alcohol just wrecks our nervous systems.
As long as you have been up front with your doctor then I would listen to him. It sounds like you have a pretty good plan going. Have you thought about ways to fill the time when you would normally be drinking? Its good to have a plan and keep busy with healthy alternatives.
This is a great forum with a lot of great peeps on board. It is totally worth fighting the battle to quit abusing alcohol. I have no regrets quitting, I've only had a couple rough days through out my 2 months sober, the majority have been pretty dang good! Life is still life though, $hit still happens, I just deal with it sober now.