Good stuff.
Not his behavior, of course, but that you are at least thinking about the fact that this is not good for any of you.
Can you get in touch with a local shelter or some such? You don't have to go there, but they are often full of good advice for people in exactly your situation.
Time for the big girl's panties. And if you can't do it for you, then please do it for your kids.