"...he told me that I am using the girls like pawns and that if I really cared about them I'd do whatever it took to ensure he had time with them."
Seriously? wow, it's STILL all about him isn't it.
You did what you needed to. Your D3 was sick...not gee she has a runny nose sick but pneumonia sick... He's a moron. a selfish moron to boot.
He could have come to stay w/ your other daughter but CHOSE not to.
Now he's trying to blame you for HIS decision.
CRAZY.
Giving him options or extra time just isn't worth the hassle it causes for you or your kids. I think I would stick to the visitation agreement. If you need to take the baby to the dr. do it...just send a text and tell him you'll produce a dr's note if he wants proof.