Hi, and welcome from me, too!
One suggestion, don't make any ultimatums until you are absolutely sure you will carry them out. It sounds as if you are ready to be done. Before you take any action, though, I suggest you talk to a lawyer. Even though the house is in your name, if he has been living there you may have to go through an eviction proceeding to get him out of there. The law is different in every state, so you really need some legal advice. In addition, you need to know what your rights and obligations would be if you separate and/or divorce.
One thought--you might want to talk with a domestic violence advocate to find out whether you might qualify for a restraining order/order of protection. Verbal abuse sometimes qualifies as "harassment", which can be a basis for obtaining such an order. If you qualify for one, he would have to leave and stay away from you and not contact you in any way. Might be worth looking into.