It's always hard to be the one who has to look out for the bigger picture with children. The children can't see that bigger picture, so they react to what they see, often pushing back against us.
You just have to know that what you are doing is right. You may not get thanked for it now (or, possibly, ever) but it is still the right thing to do. You certainly aren't doing this easily or impulsively. I'd trust your gut here.