I have been there through all the good and bad and have seen how his family has treated him beforehand and now.
How much good and bad did his family witness and deal with before you came along?
The only way this is going to effect your lives and happiness is if YOU let it.
His family, allow him to deal with them as he see's fit.