Don't let him take that progress away from you, sadconfused. It may feel like it was taken, but it was just shaken, physically, by him.
No one can tell you what to do in this situation, and it's still a bit unclear what actually happened to you, but bruises are not a good sign.
Like you, I am tired of being the only one who remembers those awful nights... or at least the only one who admits to it. It feels like they simply wash their hands of it while the nightmare plays out over and over in your mind. Lack of memory is no excuse for your partner to avoid guilt and make changes in his life so as not to scare you anymore. Show him the bruises and ask him to think harder.
I want to tell you to leave right now, but only you can decide that. I hope things get easier for you. I hope you have a friend or family member who can give you a big hug.