You sound so strong and your head is in the right place but I second the suggestion of talking to a lawyer and also with a domestic violence counselor if he's going to get ugly. Between the two of them they can help you find a plan, with all the t's crossed, that keeps you and the kids safe both legally and personally. If he has the potential to get ugly, you need both those bases covered.