It doesn't matter what category you plunk it under, as with everything in life if you find it's a problem you should take steps to correct it, regardless what others say or think! It's your life, conscious & reputation, not theirs so do what's right for YOU.
If you find your binge drinking is the problem, perhaps try putting a cap on how much, or even offer to do more designated driving so you have to limit yourself. Perhaps for a few weeks, have sober weekends (not alcohol from Friday evenings through to Sunday evenings)
Worst comes to worst, just drop the stuff for a while & see how it makes you feel
Hope that helps?