TFM, I wouldn't give too much credit to your AH's stories of what your friends say about you. It sounds like he's projecting his own thoughts onto them. Also remember they'll probably say what he wants to hear to his face and keep their thoughts to themselves.
You say you withdrew from your mutual friends, but they might be missing you. Or you can join some groups and get out there with other people. It's not easy, but your have a new life to build, even if it feels hard to do.