Stop thinking about him and think about your kids. I don't know how old they are, but kids are very observant. Show them that it is NOT ok to live this way and that you all deserve something better. If you continue with him, they will take their cues from you and think that this type of dysfunctional relationship is normal and ok. Is that what you want?