you've mentioned physical abuse. that trumps everything else. your safety must come first. he is unstable and you are in danger. he is the exact man you found in bed with another woman, just a few years older.
sorry to be harsh. but he has threatened you, physically assaulted you. he is using. it is real and scary and must be ended, for you and the child