I'm confused.
He walked out on YOU.
Why is he so angry at you? Because you want your girlfriend to act as a 3rd party when you exchange your daughter?
If I'm understanding this correctly then he sounds like he is off his rocker!!! He is projecting so much of his crap and self-loathing onto you it's unreal! And this is what alcoholics/addicts DO especially when their favorite punching bag isn't immediately accessible!
I hope you can get some distance between the two of you real soon 'cause he is tearing you down so much you can't even see your own self-worth anymore. I'm so proud of you for blocking the texts. That's just awesome. Stay in counseling, ok? Keep posting here. You're being so strong and you're doing the right thing. (((((Hugs))))