What does it matter who's to blame? You are miserable. You both seem out of control.
You have a whole hosts of reasons to leave him. Do you have any reasons to stay with him?
What is your situation? Do you have friends and family and a way to support yourself? I hope all your emotional eggs aren't in this one basket.
I'm sorry you are in such pain. Maybe it's time to sort it out with professional support.