Tyler,
I really appreciate your post, I have been the kid in this situation and the parent so I can understand you point of view entirely, but I can also understand your son's
what do you think your son wants/needs from you at this time?
You are his dad, his example, his superhero, his parent - nothing on this earth will change that, that bond is there.
Maybe your son will feel torn b/w a number of people in this situation wanting his attention (all loving him), sometimes letting a kid have space and be themselves with no expectations is the best gift of all.
Why don't you write him a special fathers day letter from father to son, he can re-read it afterwards and know how much it meant to you to see him.
I understand Tyler I really do, hang in there and focus on your sons needs, it makes what you need to do so much clearer and so much easier