My two cents - yes, you are right to put yourself and your sobriety above others. They won't clean up the messes you make if you drink.
I have not had to cut anyone out of my life, thankfully; even my friends that drink - they respect my decisions regarding my life and sobriety. I've had to keep a few family members at arm's length due to their toxicity on my life in general, not necessarily my sobriety.
Take care of YOU.