Is it me? I really don't understand why you feel guilty. If someone treated me like crap and didn't respect me or appreciate my making an effort, then no way would I feel guilty about leaving them to eat dinner alone or denying intimacy or anything else for that matter.
You're worth more than that girl! Keep telling yourself and start believing it, it's true!