I know when I was drinking I didn't want to go to a doctor because I didn't want to know how sick I was. You should be concerned but like a car with bad gas it is pretty tough to diagnose what's wrong until the bad gas is flushed out of the system.
If you want a reason to quit do so because you don't want to kill yourself or someone else