I think your anger is a good and healthy response - maybe you are asserting your value and are appropriately angry and who he really is?
When I started to see my ex clearly, I was really angry at his selfishness and selfservingness. I went from suicidal depression to homicidal rage! I just kept remembering the 4 stages of grief and that this too shall pass.