No judgment from here, either. I have gone back for rounds 2, 3 and 4 more than once before I was able to toss in the towel.
I would say you're in a good position to set some boundaries for yourself. Remember, boundaries aren't what he can or cannot do, they represent what YOU are willing to do or not do. For example, I am not willing to be in a conversation with someone who yells at me or degrades me in anyway. I am not willing to ride in a car with someone who is very angry and is driving.
This is some new territory for you, and you both can learn and grow from it.
Good luck... and we love you no matter what happens.
Cats