lexus....I haven't been in your shoes but I am a mom and I've known alot of moms. Those bonds run deep and I think that the emotions felt today during an awkward first meeting could be alot more superficial than you 'feel' they are. Give it time and as things progress both of you may become more secure.
As an objective observer from what you shared about your visit...I am impressed to learn that he started sharing feelings and memories like he did.
When will you see him again?