Unfairly?
He's a drunk who's cheating on you.
In what universe (except his) is it unfair of you to kick him out?
Sorry if that's harsh. I've been there. I spent way too much time worrying about whether I had been fair to my AXH. Because maybe he was just really angry and didn't really mean it when he said he would kill us all?
You're a smart chica for getting him out of your life now. Chin up. Forget him.