Funny story bam.. I also would not have thought of it as a personal attack, unless he were to shove you and say something like "quit smoking stupid". lol If he was a younger cute guy then I would have absolutely no problem with him striking up a conversation the way he did.
I liked your response. I would have just said something like "can you please mind your own business?" but thats just me.