You're scared because you should be. That's your rational voice attempting to over-power your addict voice to make you realize what you're doing to yourself before you spiral further out of control. I ignored those feelings (using more alcohol) for years, like a lot of addicts do.
My advice (if you want to stop drinking) would be to go to your doctor and tell him/her the full extent of your alcohol problem and what effect it is having on your life and go from there.
I hope things get better for you.