GET OUT NOW! Don't worry about him!!! He will save his own damn self! Save your baby and you!
No one would ever question your motherly instincts knowing what you just said and the fact that your baby is crying more doesn't surprise me.
Do yourself a favor and GTFO now!!! He will change his tune for a little while to try and woo you back in but it is just smoke! He is dangerous if he's got his hands and lips all over you like you say!