The kids could be dropped off at a 3rd party, grandparent or aunts. MY next concern would be is he bad mouthing u to the kids. This is all to common but very destructive. If that is the case then supervised visitation may be in order. He may not be drinking but he is certainly not in recovery. Take care.....