He did end up leaving the next day. I came back at noon (the kids did not want to come) and he was home, waiting to say goodbye. We both cried and cried, we hugged, exchanged "I love you" and he left.
It's been 5 days now and I'm still not sure how I feel. Just sort of "fine". I guess I thought the change would be more dramatic. The kids say they are fine but I know there is a lot of underlying pain there. I do have to admit that we are all more relaxed.
I'm not sure what to do now. I haven't been without him in 22 years. I have no clue how to get on with my life.