Hi,
That does make things difficult, but as Rowan said, you have choices.
We have a no alcohol rule in the house and that means literally, never, any alcohol. I am very thankful for that. My husband stopped drinking when I did, not in support of me, but simply because my drinking put him off alcohol. Again, I am glad he doesn't drink, but, of course, it would be alright if he did.
Have you tried talking to your partner about your concerns and maybe you can come to a compromise?