Everyone here is spot on - I have nothing to add except I've been there and I hear you - it sucks. But these folks here are right...it has NOTHING to do with you and your actions and everything to do with what's going on inside him. Don't take it personally. It's his issue.
Hang in there!
~T