So sorry jarp crucial thing here is that this is your AH's version of what was said, not what was actually said. You need to look after yourself here. Don't listen to him or third hand accounts, listen to your gut and your friends that you trust. Do you go to alanon. Listen to yourself and work with your own power and don't give up your power for anyone.
Mind yourself and don't dwell on any thing you have been told that you know to be a lie. Hold on to the truth. Sending you hugs.