Gwen, what you said about him being the one who can take care of the kids and you won't interfere with that ... that is so beautiful. You are truly a good mother - you truly love them. So many people get petty and use the kids as part of the drama.
Yes, you're going to have to wade through all these consequences but I have a feeling you are really going to be okay.