You could also text, if he persists, "In light of recent events, I am not comfortable with a friendship between the children at this time. Thanks for your understanding". And leave it at that. You don't have to justify, argue, explain or defend anything. Your house, your rules. And this neighbour dude is just going to have to learn to respect the boundaries.