I was also always the one drinking the least of the group, which is why people were surprised when I quit, I guess. They saw the two or three I would have while out; the six I'd drink alone when I got home were less obvious.
It does seem to run in the blood, so to speak, though I'd consider heredity to be an excuse only if you use it to avoid fixing the problem.