Honestly, I would have left immediately.
There is no reason to spend any amount of time with people like that.
I hope that you will not put your children and yourself into a situation like that again and good for you for continuing to work on your recovery.