Its typically much harder to leave an abusive relationship than a non-abusive one. For one thing you could be afraid of an abusive backlash from him which is reasonable, plus living with someone like that can make a spouse too depressed, unmotivated, and having low self esteem to get the energy needed to leave.
Could you get some help and support from a good counselor who knows what abuse looks like? Professional support was vital for me leaving my ex abuser.