I understand your fear. what i don't understand is why you feel you should be dialing his voicemail to listen to his personal messages....This says that you still want to keep some form of contact, knowing him. Getting involved with his business.
then you cry wolf.
If you were truly done you would stop texting these people to defend yourself, giving them information and block ALL THE FAMILY numbers permanently or CHANGE yours. yet you keep interacting and then trying to explain your "reasoning".
like someone above said, you keep jumping back in, why?