No reason to feel guilty. He's doing what he needs to do to gain the benefits of sobriety. You need to do what helps you and the kids. For the meantime, focus on yourself. Find meetings and read the literature. Work on your recovery. Let him work on his. I'm really happy to hear he is upbeat and feeling good.
Blessings