What impact is this having on your children?
Verbal abuse is never acceptable. It will wear you down and erode your confidence.
Unless he can make positive steps to address this immediately, I would question his motivation to change.
You and your children do not deserve this.