Absolutely say NO!!! just because he wants everything his way, you don't have to acknowledge him.
ASSERT YOURSELF.....no one expects you to continue to revolve your life and that of your child around him. No judge expects this and don't worry about "looking bad", that is not how it looks.
Is he paying you ANY child support? Have you asked him?