The worst of my drinking hit me at about 39. I drank similar to you up until then.
As far as "other people" go....well it will progress and "other people" will NOT pay your SR-22 insurance when you DO get a DUI. "Other pEOPLE" will NOT support your family if you lose your job, and they will NOT be the ones in a hospital bed with tubes coming from every orfice in their body when your health fails.
Just sayin