I know how hard this is. (((HUGS)))
I was a wreck for a while regarding visitation, but all in all, it was fine. In fact, after a few years, he started slacking on visitation and by the time our daughter was 12 years old, he pretty much stopped getting her altogether.
Those stipulations in your agreement are actually pretty good...better than mine were. It is rare that we get everything we want in a divorce, especially when kids are involved, but it looks like you did very well.
I'm sure everything will be fine, but if not, you can always take him back to court. Nothing is forever when it comes to child custody/visitation. Again, (((HUGS)))