I say if you're going to hang out with drinkers you better have thick skin yourself. You're going to have to chill out and roll with the jokes that will come your way about not drinking.
When I drank and you may have been the same way, I didn't want to hang out with sober people because they always looked at me like I am some nut case. When with another drunk we're eye to eye having fun.
At any rate have fun with them being the sober one you are or you may have to stop hanging out with drinkers - simple as that. There are plenty of sober people to hang out with and none of them are at bars.