WTBH I do think words hurt (even when we know it is not really about us) and like LaTeeDa said not listening to it is best. Like the others I too am worried about you. If I were in your shoes I would make any future meetings in a very public place. Less likely he will hurt you or pin you down and if he does there will be others to witness it so you can get a restraining order. As you have indicated his illness is progressing and I would be worried that would equate to more violence. If at all possible I would cut contact with him and only discuss stuff via an attorney.