I VERY rarely drank when I was living with an alcoholic in recovery, but that was mainly to support his sobriety (which I still think is the decent thing to do--especially in early sobriety).
Once I was no longer living with him, that's when my own drinking ramped up and yes, I eventually became a full-fledged alcoholic.
I see nothing "wrong" with enjoying a drink now and then if you don't have a problem with alcohol. I also can imagine that having a drink might bring on unpleasant associations.
Heck, my last relationship totally KILLED my enjoyment of television. The guy simply had to have the tube on CONSTANTLY. I finally decided it was ridiculous to keep paying for cable when I never watched it. I now pay $10 a month for the most basic cable. I don't know that it was a huge loss, but it was something I used to enjoy that I now don't.