Yes it is a gray area.
I would think that you can only adhere to your parenting plan as you can't control what happens in public situations.
It's such a shame for the children.
At least you know they won't be going home with him like that & that their safety isn't at risk.
Hang in there.
Hugs.