Congrats on 3 weeks!
Maybe I already know what I should do
I think this is true. We get pretty good about arguing our gut instincts in the name of giving someone else the benefit of the doubt. This isn't necessarily a bad trait initially, but people like us have a tendency to do it over and over again despite the facts, and to our own detriment.
So - the facts are
He says he loves you.
He drinks, and you are newly sober.
2 months into reconnecting he became verbally abusive again.
This trait hasn't changed int he 2 years since he was verbally abusive to you before. (Drunken tirades are an abusive situation.)
He is blaming you for the relationship ending - again.
Listen to yourself - the you that wants to protect your sobriety and heal.
FWIW, there are studies that say that most addicts are codependent. Are you working a program? If not, maybe AA or Alanon might help you work on you. You deserve sobriety, and eventually a healthy partner.