If you're afraid of him, and you should be if he's being a total ass, you need to get a constable in there with you so you can safely pack your things and get as far away from him as possible.
He's not going to change until he's good and ready so don't count on him changing anything but the tone of his voice with you.