Alcohol is the only drink you have to justify not drinking to others.
People will ask you: "Why? Do you have a problem / are you alcoholic?"
This shifts the attention away from other drinkers who may, quite reasonably, be drinking in more moderate amounts than you have been doing recently. What is not considered is that these same people may be at risk at different times in their life, be that in the short or longer term. (or may already be in trouble due to drinking).