I went through a very similar feeling where I wondered if I was overreacting. Time, space and healing helped me see that I was not overreacting. Seeing someone once a week will be confusing because you will only see the best parts of them. You know what he's like all the time, not just when he's on his best behavior. I would certainly recommend no contact.