A stubbed toe hurts as much as a broken bone..
I can think of many reasons why he would say such but I can only think of one reason why it would bother you.
We can't control what other people think or say.
We can only control how we react.
If it bothers you...work it as a resentment and if there is a next time...
Thicker skin and the realization that others may need do some learning also helps let it roll off the back like water on a duck.