As I see it you are a threat to these people. They are not really your AH friends they are his drinking buddies and you are trying to take him away from that. They support each other in their habit and you do not so that makes you the enemy. My AH buddy told him that He and his wife did not feel I did enough around the house. WOW!!! did that make me blow my top. How dare they judge me when they did not live with me. They did not see what I did around here. They did not see the things he needed to do.
Anyway after many discussions with my AH about him not setting them straight I finally got through. I fought tooth and nail and pointed out the manipulative ways of these people. He finally saw it for himself. He saw that when he had nothing left to offer these people they showed their true colors and they are no longer in our lives.
Stay strong.
Z