I am also not really into religion. I have been going to Al-Anon for a couple of months now, and religion isn't that big a part of it. At least in my group. (And it's held at a church)
I go to hear from others who have been where I am. Each time I go, I feel less and less alone. There are others who have been where we are. There is something very fulfilling about sitting in a room and being face to face with others who have been there.
If nothing else, that makes it worth going for me.