Sadie, you did say this twice, correct? In writing? I'd think that is clear enough to any rational person. But as an alcoholic, he is not rational. Doesn't mean you owe him anything more, just don't be surprised or guilted into responding to this bait.
Yes, I do think it is manipulation to draw you into a conversation.