Set that schedule...ignore his calls or silence the phone...
The person that blames others isnt' looking inward. You can't work on yourself if you don't look inward.
I think you are heading in the right direction....protect yourself and your sanity for your kiddos.