I think your initial instinct to put this marriage behind you was a good one. I'm not buying his "sorry" as demonstrating any real remorse or determination to change.
Stay out of the other woman's life. No good can possibly come from that.
I'd work on healing YOUR heart and moving on so you can eventually be in a relationship where you are valued and respected.
Hugs,