I think the response is good. You may have to explain to him what it actually MEANS, as in "you don't get to have the kids over at your place until you show that you can provide a good environment for them." I wouldn't deny him visitation altogether...that might play against you later on. Perhaps you can offer to meet him somewhere public with the children for an hour or two. Or (and this is entirely up to you), he could come over to your place so you can supervise the visits.
As for a legal consult, I found mine by searching online for "free legal advice" in my geographical area. I called a few numbers, left messages and two different lawyers called me. I got a good idea of what I could and couldn't do. I was also directed towards legal aid should I ever require it...Is there something like that where you live? Might come in real handy...