It is very individual. I have one year into recovery, and weirdly, my ABF's alcohol never bothered me. I think, though, that I mostly drank to self-medicate my extreme issues with anxiety. Once I got my anxiety under control with medication I was ok. (Don't get me wrong, I will never drink again and I identify as an alcoholic, but I think I arrived at alcoholism in a bit of a different way.)
Anyway, I agree with the others who said that you may need to cool it until he is stable in his sobriety - a year in or more. It is a small price to pay for his health. Later on, you may be able to reintroduce it to the home, or maybe not. You may have to reserve your drinking to dinners with friends. It isn't fair, but it may be the price you have to pay to be with him.