I still think you are giving him way too much power, that being said completely block his butt. No reading but not responding. That is clearly stressing you out.
Sounds to me like he hasn't contacted your family yet, or they would have mentioned it to you I would think.
Just ignore him and if you feel you need to get a restraining order and get the police involved.