Yes, that is why I said you don't "have to". You can if you want to, certainly, but the point that I don't want to get lost in all of this is that You Get To Decide What Your Boundaries Are By Yourself. No one gets to approve of them before you are allowed to have them. They aren't negotiable. If his feedback is that he doesn't want to feel guilty about drinking because you don't want to hang out with someone who is drinking, well then, his feelings are HIS responsibility, not yours.
This is true in any healthy relationship, regardless of whether addictions are involved.