Boundaries, boundaries, boundaries.
Verbal agreement void if his actions don't fit a respectable behavior.
That would be my thought.
His behavior is not something the children need see. His behavior is teaching them it is ok to be abusive to women.
If not for yourself... set some boundaries for your children.
As to what he said and what it really means...
When he says he feels fine till he is around you... he feels fine till he is reminded how much his actions towards you are wrong and rather then deal with his feelings and actions...can't be me so it must be someone else...you are the closest one he can blame and get away with it. Boundaries are needed.
His harsh words towards you are his feelings towards self that he won't accept.
Don't take them personal (yes harder done then said) but know that it is not you. It is not truth. It is alcoholic behaviors doing the talking.
Boudaries....