IMHO....I would email him, tell him because he is putting you and your children at risk, if he continues you will be forced to put out a restraining order against him...I'm sure that will make him think twice about sticking his nose where it doesn't belong.
NSW