Am I missing something here?
He wanted to stay the night but then hassled you about what "he" wanted and called 14 times on your way to work which you ignored...and then talked to him on the work phone?
Sweetie, I'd say you are sending mixed messages and the only way you will get through to him is to be clear about your boundaries.
Your uncertainty about what you want is showing and he's picking up on it.
Perhaps taking some time just for you, without thinking about what he wants and deciding what you want...may make all this just a little easier.
Hugs