So many good things to agree with here.
Don't reply, it will only feed him
If you do reply, don't for several days. I always take a few days to reply when I am upset. I know how bad I can be right out of the box. I need time to think things through and be calm.
You should never give up Yoga. This makes you feel good about yourself, and it doesn't harm others. You come out feeling at peace and I bet your kids appreciate you afterwards. My kids sure can tell a difference after I put in a good hard run, hehe.
Most of all, he is continuing to point the finger away from himself. Don't look at that finger until he points it at himself. That is where the true blame lies.
Be strong! Your SR friends are here for you. =)