Well, I recently left. I had those same fears/reasons for staying. I can tell you....it is a little lonely, but the trade off to have peace made that worth it. I reach out to friends. If they are really your friends, this won't affect that. One thing to point out....there was one particular family that I was worried about "losing". I am now closer than ever to them.
Everything that I thought that I would lose is still here. And on top of it, I have gained so much more!
M