Well, I didn't have that "physical reaction to him" when we were together, or even after the breakup. It's more that with time, I've realized how damaging that period of my life was, and encountering him just kinda brings all that up in a rush.
Let me put it this way--I see no good that could come of our having a conversation.