I feel like that sometimes, like I'm depriving myself of "all that fun", but it's all in my perspective and in seeing things realistically.
AA was a big start in helping me take a look at myself and what I was doing to contribute to my own unhappiness. Changing the way I look at the world made a big difference for me.