Talk to your attorney. I wonder if it would be possible to call the local police and ask for some sort of civil standby, meaning that you ask them to respond and witness that you are there for the court appointed visitation but that your husband is violating the terms of it and you can't leave the children with him.
So sorry you and the kids have to deal with this.