I would consider telling him that the next time he tries to have a conversation about the relationship in front of the kids, he is no longer welcome in your home.
Of course, the only way to keep him out is a court order. You can get an interim order, in most cases, fairly quickly. As between you and the kids, and him, I doubt whether a judge is going to make YOU move out.
You already have the prior court charges re the domestic violence. There is documented history. I don't believe he would have a prayer of staying in the house with the kids, under the circumstances.
Please talk to a lawyer and find out what your options are.