He's a little insecure about being the sober guy who can never touch a drink while everyone else does, and couldn't help but feel maybe I would rather be with someone who doesn't have theses issues.
Well, you could tell him that drunk guys are as a general rule way less attractive than sober guys.