I was in a similar situation, though I did not have the advantage of financial independence.
Sounds like the ball is really in your court here. He has no real desire or motivation to change anything. The more you put up with and stuff down and hide from the world, the more crap he will throw at you.
What do you feel is keeping you stuck?