Deep breaths and long showers…that will help you. You will be ok. If I remember correctly, this is a relationship that is leading you to a place that you do not want to spend your existence. His family is just that, his. Do you have any support. Girlfriends, neighbors, sisters etc??
If you stop taking care of him, there will be plenty of time for you to take care of you and the kids.