Please trust your gut. I feel like humans have developed a sense or gut instinct for danger but because of societal norms we don't listen to our "gut" as much. (Example: sketchy guy tries to chat you if you're a small female, he ends up following you, but you're too "polite" to tell him to GTFO.)
I think you know the answer to this conundrum but want validation for cutting him out of your life. YES, do not feel guilty, and do NOT listen to his manipulation.
I teared up listening to your abuse. Please know that this is not normal behavior, you did nothing to instigate such violence. Imagine if you had a sister or best friend who was being abused in the same situation. Wouldn't you tell them they deserve better and LEAVE and never look back? If you love your best friend/sister/etc, you've got to see that you show YOURSELF that same level of love!!!!
Hugs.