Instead of putting all this work into why he is doing what he is doing, and visits with him, you deserve to take the time to figure out why you will not part with someone who is treating you this way. Just my opinion. Naranon would be a good start.
I am sorry, I know it hurts. Just know that you deserve more.