Take the advice and contact your attorney to handle this, then defer him to no longer contact you.
Its hard to follow what you are saying as the dates are confusing, but as I read it he was slack in submitting paperwork, and missed payment(s) from your pension.
This is just a matter of arithmetic. He has shown in the past to be impossible to discuss things with of financial matters. I'd pay my attorney that one hour fee to shoot him a letter outlining who owns whom what. If you owe him you'll just send him a check. If he owes you hopefully it can be worked out. If he isn't satisfied just put the onus on him to hire someone else an spend thousands trying to collect far less.
He sounds bored to spend so much energy arguing over this when it could very easily be worked out amongst the two of you. Perhaps you suggest he and his amazing woman take up a hobby, as he apparently has a lot of spare time.
