I don't get how you would see this as anything but a HUGE blessing. I get it, the heart wants what the heart wants but this has nothing but disaster written all over it. If you keep letting this guy back in your life things are going to get much, much, worse.
You would be very wise to completely block this person out of your life and move on.