You are not required to talk, you can just pass when it's your turn. I am shy about these things too and I have passed before. It might be nice just to get out of your house and listen to others talk. Yeah, I also agree though, stop taking his calls and don't feel bad about it. He sounds awful (and I don't say that to be mean, my AH is just as bad in his own way!).