I too know the pain you are going through. I had my 21 yo son move out, he went to live with his dad. You did what you had to do for your safety. The baby does not need to see this, and he could hurt her, or YOU. Attend as many meetings as you need to. You did what was right for you, and that is a good thing. I pray that this is a wake up call for him. You did good by telling him to go find help someplace else. He knows what he has to do to come home, and I pray that he does it and works on his recovery. If not it is his problem not yours. Sorry if that sounded harsh, that isn't what I want.
It took me a long time to say know to my son, and it almost killed me when I had him move out. Today I am stronger, and happier than I have been in the last 3 years.
I will pray for you and your family,