Fear of the unknown can be paralyzing because we think of the horrible "what ifs." Well, what if you left and... OMG, you were happy? Egads, you had peace? Really, you supported the kids just fine?
He says "you can't," but what he really means is "I can't."