You have both been through a lot. Try to give yourself grace and time. Everyone has their limits with what they can take, it sounds like you did your best. You have the right to protect yourself. Is he open to reconciliation? have you considered individual or couples counseling? HUGS!
~Ducktapetherapy77