When you say "a couple" what do you mean? I suppose only you can say if you have a problem because it's more how you feel about yourself than what others see that makes you want to quit.
I didn't drink like a hardcore alcoholic either but it was coming... Maybe you see the writing on the wall? Maybe you are getting uncomfortable with it and your gut is telling you it's going to get worse?
Not sure what to say, can you tell? LOL