You're trying to apply logic to an illogical situation. It's rational in one respect--from his perspective, he can do whatever he wants and you are willing to keep putting up with it. So it makes perfect sense from his point of view.
Yes, it's "unfair," but being unhappy and complaining about the unfairness does zero for you. Given that there's nothing you can do to fix him, what are you willing to do for yourself?