You need to focus on yourself, your kids, and growing a wonderful healthy baby. Your kids need a happy, stable home environment. I'd say get this guy out of your lives. Maybe someday in the future, he'll be clean and you can reconsider the relationship, but right now you need to nurture yourself and your life.