Well, it doesn't sound like you have had enough yet. You have to really know, deep down in your heart, that you are ready to back up your boundaries or they are useless. It makes them idle threats because you really only want to change him, not do what is best for yourself, regardless of what he chooses to do. At this point, it sounds like you want him to change so you will be happy instead of doing for yourself what is best for you.
Once you are truly done with trying to change him, or make him "see the light" or in any way get him to do what you want, will you be at a point where you will save yourself and be determined to do what is necessary for your own serenity.