What he is doing is no reflection on you. He is just an alcoholic doing what alcoholics do. In his alcohol soaked mind, he needs to be with someone who won't interfere with his drinking...someone who will drink with him, or at least not hassle him about it.
You deserve better. The longer you keep up with what is going on with him, the longer you are going to feel this way. If you want peace, you will have to accept that it is what it is, and then put a stop to any contact with him. That includes hearing about what's going on with him from others. In this case, what you don't know can't hurt you.