Abuse is never okay. You are worried about leaving him because of his feelings, but it sounds like he's not reciprocating and considering yours. I don't know about you, but I would be a lot happier today had I left my ex wife when her abuse really started ramping up.