...agreed. I don't think you have to get defensive about it. Just explain it to him. I know my wife never expected me to buy her drinks after I stopped drinking.
If I were in his shoes, I don't think it would hurt my feelings at all if you didn't buy the booze. He will probably understand how you feel, but you've got to tell him first.