Deep down, you know whats best for you Teal - do that.
Noones asking you to be selfish - just acknowledge that the factor of primary importance in your life right now is your recovery.
In my case I figured if anything came before my continued sobriety I'd lose everything I had anyway - and hurt a lot of people besides.
I'm not sure how you staying clean, and rebuilding a sober life, could be 'detrimental to the health' of the other people involved in yr life.
D