If you are waiting for him to give you permission to leave, to be happy about it or understand, you will probably be there seething with resentment until your old age. You have to give you permission, it's your life.
Any break doesn't have to be permanent if you both want to try again later, after he has demonstrated continuing efforts, and if you feel differently towards him. I understand the feeling that the ship has sailed, that you are done, and his efforts seeming too little too late. Whichever decision you make, as long as it isn't guilt based, will be the right one.