Just remember, his actions are his...his choices, his sickness, you do not have to feel any responsibility for what he has done. That is not your fault.
Take care of yourself. Take these truths as gifts to strengthen your resolve and build your relationships that are worth it, like the ones with your daughter and grandbaby.