If you feel you have been beyond fair and tolerant, then yes, you are right to do what you did. No one can tell you what you can stand to live with. We all deserve peace in our home and it doesn't sound like you were getting much of that. He was allowed to come back on the basis of a plan. He hasn't kept his end of the deal. You, therefore, do not have to keep your end. It sounds like you need a good deal of time away from that chaos to let your mind clear. Hang in there and stay strong.