I go thru exactly the same thing. I can't pinpoint it.
I think sometimes I'd just angry because in my heart I knew that I couldn't use anymore. That may not have been it but it was just as hard as breaking up with someone.
Wish it would be easier though.