My XAH usto say that. So then I made a deal w/him. Ok, you can drink two beers. Low and behold, that did not work either, and he still drank more and hid it.
I would bet he likely drinks more than you know about.
Ultimately, if it bothers you in your marriage, it's a problem.