Awful to hear this... the ball in clearly in your court to take care of YOU and the young one.
I wouldn't doubt if he's bluffing about filing for divorce... mine said the same thing a few times... and it was me who ended up filing for divorce...
Obviously...it is not a safe environment for you or your baby to remain in contact... Hope you can make the appropriate changes needed.
Take care and keep us posted.