He didn't want you to leave so he could keep drinking in peace, he wanted everything to stay exactly the same as it was. He was comfortable there and didn't have to face the fact that his drinking cost him anything. Until he is ready to admit that, he needs everything to be your fault.
"How" do you let go of this? By accepting him for exactly who he is right now, today, and not wishing he was someone else.