IF you were to go back to him, what would your very clear message be? That you are willing to tolerate violence.
Since you are now willing to tolerate violence, where exactly is the line that will be drawn? And how will you explain that boundary to him so he clearly understands? It's ok to demolish the house but just don't touch me? It's OK to verbally and emotionally abuse me, but just don't hurt me physically? You can't say, "I'll come back but I won't tolerate violence" because your actions say something totally different...making your words meaningless.
IF and WHEN he crosses that boundary, will you then move that line again?
Or are you assuming that your leaving has sent another message and that he has "learned his lesson"? Really....it doesn't work that way. I promise.
So....if you safely assume that things will not change and will most likely get worse (because you've now given the message that violence is OK)... are you willing to live your life that way? The answer is simple: Yes or No.