You do have a complicated "relationship" with this person, and that would lead me to caution about how much investment I would put into seeing something develop out of it for work or otherwise.
Trying to grow something out of the type of connection that you have with him seems risky. Are you really ready to open yourself up to such a situation, again? I just am concerned that you might feel hurt if nothing comes from this. You have been through so much already.