That whole you make me drink line of thinking is this disease shining thru.
Unless he truly works some form of a recovery program, his quacking will not change.
He knows why you left, he just thought that after a friendly conversation earlier in the day, you were willing to be sucked back into his disease..
Have you tried no contact for any length of time?