Sounds like you handled it just fine.
It's possible there won't be huge consequences for him this time, but he's just taken a HUGE dent to his credibility.
In my experience, these guys tend to do way more to themselves if we give them a little bit of rope than anything we could possibly come up with on our own.
Don't worry about your agreement. You don't have a fatal loophole in there. If he keeps this up, the court will have no choice but to intervene.