It is ok to feel something (sorry for him) but to act to protect yourself against damage (go no contact for the time being).
These two things can coexist. You don't have to give him access to you, which may be harmful, just because you feel bad for him.
And yes, of course you deserve better!