Matt, I don't have children by choice and I've had to defend that decision all my life. I'm a partial vegetarian, and that has been a reason for people to say some really silly things to me. My mom thinks that people who don't drink alcohol are dull and no fun! Anything that sets people apart from the "perceived norm" is reason enough for some to offer resistance to that choice. I'm sorry your family got to you!
I have to remind myself that just as I'm learning to speak my truth in recovery, others are in their right to speak theirs, even if I don't like what they have to say. I hope you find your serenity soon! ((hugs!))