Assume for a moment you had never been with an Alcoholic. Or that they didn't exist.
There are still plenty of things that make a man the wrong choice. As a man I could say I have gone for the wrong person at least once in my life. And alcoholism wasn't a factor with that person.
Don't over think what the guy is saying. Many women I know complain about the sour luck they have had with guys. The same goes for the guys I know. However I also see these guys and what they stand for and actually feel like they have it coming to them a lot of the times.
I don't think he meant anything negative towards you when he said that.