I think "young age" comments probably reflect a bit of envy among some. I knew in my twenties I should quit, and if you're doing it at 25, more power to you.
No one ever accused me of quitting early (at 41), but some people questioned it as I wasn't a public heavy drinker. There will always be comments that throw the AV into overdrive, but you can choose to not give it extra space in your head.