Definately get in touch with a domestic violence agency or support group. They are a great resource on how to educate and protect yourself. Even if he never lays a hand on you, what he already doing is abuse and it does escalate.
Also living with the fear that he may hit you is abuse as well. That is a very stressful way to live
Glad you are reaching out. Stay strong!