Maybe you could use some of the detachment and boundary-setting that you've put into practice with your BF with your family. If they make rude comments, say that you'd would prefer that they didn't and if they continue you will have to leave/hang up the phone or whatever. You don't have to shut them out of your life altogether, just make some topics of conversation off-limits.
Love
Minnie
xxx