Do you have a temporary restraining order? Are you filing for a restraining order to keep him away from you as well as away from your daughter?
When I got an RO, it was made clear to me that I wasn't allowed to do anything to cause him to break it... i.e. calling him for any reason. I would recommend not calling him for anything, even about your daughter. Clearly he does not care about her well-being anyway. It's sad, but to him, she is nothing but a way to 'get to' you.
Sending hugs for you and your daughter.