turisops I think you hit the nail on the head with it being AV itself.
I also don't out myself at work. People still think I drink and invite me out for drinks after work or assume I drink on the weekends. I politely decline invites or stay silent about what they assume and I don't feel like I'm not being true to my BP. I'm protecting my reputation, saying I've quit denotes that I had a reason to.