Yay for you for not moving to another country with you X. Wise choice.
I would only advise to go sloooooow with New Guy, simply because you're having thoughts about your X. To me, that say you haven't yet mourned the end of the relationship. Perhaps spending time alone to rediscover your relationshipn with yourself might help you sort out your anger and guilt.