Going to the couples counseling is fine if you go in with the undestanding that it won't work until that elephant in the room is dealt with. You can perhaps use it to get independent reinforcement that his alcoholism is the biggest problem and roadblock to you working on issues as a couple.
Have you gone to AlAnon or gotten into individual counseling? You cannot change him but you can work on yourself and understanding how his behaviors are affecting you.