He's gone, for now, that is good. Now, change the locks, if he threatens you in any way, call the police and file a restraining order against him.
If you let him back in he will physically hurt you, mark my words, it will happen. Why? Because once you let him back in, he has the power, he knows you are weak, it is a mental game that will turn physical.
My father always said "Be like a fighter in a ring, fight fair, but, protect yourself at all times".
Protect yourself and your daughter, this guy is not to be trusted.