Sometimes we just need to not over think everything...I see no weakness in letting go, to me, it is just the opposite, it takes a great deal of strength to let go.
Enjoy your time with your family...forget about all his moods and tones, nothing you do or say will change a thing... to him it is all about him.