WAM,
If you said anything about his temperament I missed it, there is a concept in self defense called condition green, yellow, and red.
Condition green: things are fine, nothing to worry about.
Condition yellow: no known threat, but your guard is up, but watching for threats.
Condition red : there is an active threat, you are reacting to this threat.
In your situation you should always be in condition yellow, always watching for threats to go active, your cell phone and pepper spray should always be on your person. While he may not be violent now and may have never been violent, you are an active threat to the status quo for him, and violence is a real possibility.
You "go bag" should have money and credit cards, your gas tank should always be full, snacks and water should be in your car in case he takes your money or cancels your credit cards, hide an extra set of keys for the house and car.