I never had a problem having just one glass with my family either...but after the family occasion was over I would make up for all my 'good work'.
Eventually, I lost the ability to have even that one glass with my family, and went overboard there as well.
D