Make no mistake: You are not the one making his life hard.
You deserve peace, Reneevc. You deserve love and happiness and all the good that life has to offer in the precious little time we get on this earth. Your husband does, too, but you are not responsible for, nor are you or anyone else capable of, making that happen for him.