Sounds like your doc is not particularly knowledgeable about benzos. Sounds to me, only my VAST opinion on these drugs, Dr Doc tapered you off too quickly. Why don't you call this "doctor" and tell him he tapered you off to quickly and you feel like hell. Put it back on him. It's probably his fault. These doctors have GOT to develop some smarts dealing with him/her. If you don't like what he says, go to a different one. I, for one, do not take ANY doctors word at face value. I research everything.
Best of luck to you.