When my phone rings, I sometimes don't answer it. Sometimes it's a friend or family, and I just don't feel like talking. I figure if it's something urgent they will leave a message, and if it isn't, I can call them back (or they can call me back). I used to feel I HAD to answer every call.
Same thing here--you were going to sleep. You have the right not to engage in what might have been an emotionally draining conversation just as you're going to sleep. If he were having chest pains, he probably would have let you know, right? Or if the house was on fire? Or the sewer backing up into the basement? Chances are he would have shaken you awake for something like that.
So don't feel guilty. You need your rest--you have a LOT going on in your life.