Three weeks is still quite early. I think you're very considerate to think of your friend's recovery, because it is a struggle. "Get over it" attitude, imho, is completely selfish and lacks empathy. I think you're a good friend. Personally, I would probably invite him out to dinner without the presence of that family member. But that's me.