The thing is you chose to take the drink. It's that simple.
If he spiked the drink that would be a different matter.
I don't think it's really possible to avoid situations where other people are drinking for the rest of your life. Having a plan to deal with that is part of long term sobriety.