You are not pathetic, I have stayed in my share of crappy relationships for way too long.
If you are not happy with this guy then you deserve to find your own happiness, even if that means starting all over again by yourself. At least you'll have only your own problems to deal with and not his.