I am sorry for your situation. I can imagine how difficult it makes your decision. But we only have our dignity. He's shown you his lack of dignity. Don't lose yours thinking you'll hurt less if you have him with you. It will hurt more if your trust and faith in him is further trampled.
Again, so sorry for what you are going through.