I am replying without reading the responses.
You are working hard to sort, adjust, and be a good person through all of this. He sounds like someone who plainly ain't gonna budge no matter what counsel you seek with him.
It will probably get easier once you get more clear in your heart that it is right for you to move on. Not sure what is holding you back, but I am sure you will get through this transition and find yourself in a much better place.