I think it's ok to be a little avoidant of drinkers in the early days - especially if you have a little inner ambivalance about possible moderate drinking.
Time and again I'd 'road test' my sobriety and drink again. No one starts lifting 300 pounds...we work up to that - it's the same with building sobriety muscles IMO.
I needed to cherish my recovery and keep it safe until I knew it was secure.
I needed to put clear distance between who I had been and who I wanted to be.
I still went out - but not to events where I knew my recovery might be compromised.
You will build those muscles.
I'm not saying that you have to avoid drinkers for ever or that you need to barricade yourself in the house this weekend...but you don;t have to throw yourself into the drink maelstrom either
D