I'd just say 'No, thanks' and end the conversation. It's really no different than turning down the steamed cauliflower, or something else you don't want.
For me, I couldn't be around alcohol for quite some time when I stopped drinking. It just didn't work.