I have been where you are. You cannot worry about him. He has his demons to battle. And they are HIS demons.
One thing I would say is that you want to be very careful about how you leave. If I were you I would talk to a counselor, or go to some AlAnon meetings.
Leaving is going to be tricky. He's not going to just say, "Ok, honey, I understand."