You're going to hear alot of crap coming from him. Remember this: Just because he says it....doesn't make it true!!! YOU know the truth, his foggy perception and blaming doesn't matter at the end of the day. There is a HUGE difference between not drinking and real recovery. He doesn't sound like he's anywhere near recovery, he's just a dry drunk right now. That never lasts.
Move on to the future that's waiting for you and your child. Don't worry about what this guy thinks.