Newwife you have my sympathy - it must be a big shock to discover that the person you married has been concealing this from you. Would you have married him if you had known about the extent of his drinking problem which he kept hidden? If the answer is "no", then I think you are justified in leaving now. (Other posters have said this too). Sadly, unless your husband is committed to stopping drinking and is working with a recovery program, he is probably going to just continue and you'll find more and more hidden bottles.
You don't have to decide to divorce him - but you might want to consider moving out for a trial period. This is no way to start a marriage.