I have never seen my mom take a drink ever in the whole time I have been alive. I also have never seen anyone give her a hard time for turning down a drink.
I understand someone might give you some greif if they remember drinking with you in the past but I think a lot of it is still in our minds. Most people just don't care.