It gets to you because it is a form of abuse. He used both passive and aggressive emotional abuse here, as you describe his words.
There is a point at which progression is not defined as the norm of "alcoholism and alcoholic behavior."
It goes more like this: When the alcohol abuser progresses also into a domestic abuser.