{hugs} I am sorry you are in such pain. It sure sound like you might want to make some changes so that you don't welcome that pain into your daily life.
What changes can you make? How about not talking to him daily? How about no phone calls? I take it you work with him (sorry but I can't remember for sure). If so, job hunting sounds like a good idea to remove that source of pain. Now I wouldn't just quit unless you are financially able to support yourself while unemployed but hunting for another job makes sense to me.