Oh, I heard all the "you are treating me with disrespect in my own home" crap too. I guess leaving crappy underwear on the kitchen counter and fondling yourself in front of kids while you're blind drunk is deserving of respect.
Meh. Ignore him and move on with your plan, do what's right for those kids and yourself.