That is where you have to decide can you let go of the anger and resentment with him in your life, or do you need to be without him to work through it. You will never be the best you, you can be while carrying that around.
FOr me that is part of why my AH and I have separated several times as well as something I worked on when he was in jail and rehab, letting go of the anger, and its not easily done, because I little bit of repressed anger can hide on you and sneak up when you least expect it.