Could you possibly let him know you will let this go this once but will definitely be documenting and if it happens again you will be taking him back to court?
I don't really know alot about this besides document, document. I am truly sorry Rosie. Ultimately your kids will always know they can rely on you. While that may not make it all better, in the grand scheme of things, that is really what does count.
Hugs.