My sister already agreed that she will take my daughter to see him so I don't have to face him.
You are free to do as you wish; however, there is no way I would allow this to happen. No one, family included, would be allowed to take my newborn child anywhere that is inhabited by recovering addicts. I sincerely urge you to think more about this before you let your child out of your sight.