Mamaplus2kids, if you're not already doing it, document, document, document. You may not be able record phone calls and can't use those recordings in a case, but if you're consistently journalling all of the interactions between him and your children, the journal can be used.
I wish I had more to offer than just shoulder.