No contact isn't something we do as punishment or to try and make the addict react in a certain way. No contact is something we do to save ourselves and stay out of the chaos of addiction. You have every right to keep your daughter away from your brother if he is in active addiction. If you can still have contact with him and it doesn't upset you or make you feel confused or frustrated, then there's no reason for you to apply no contact with him.