Hello Ruby,
I wish I had some wise words, but I think taking care of yourself and your children should be a priority. It doesn't sound like your husband is 'done' yet. There is no guarantee that he ever will be.
If you can accept him now, as is (and it sounds like you can't), then great! If not, then you might have some decisions and plans to make.
Sending you many hugs of support, S