Physical abuse is a deal breaker. The more you let him back in, the more aggressive he will become, it is the nature of the bird.
Your first priorty is the safety and well-being of your children. This type of enviorment will have an impact on your children, this can effect their entire life, they hear and see everything (whether you realize it or not).
I know, I lived it as a child with my parents, they both drank...it was not a pretty story, it took me years to sort the whole mess out...today at 62, I still have battle scars.
A verbal apology means nothing, it is just a bandaid, actions are the only apology that truely mean anything, they do all the talking. Take care.