If the relationship is broken that will be your brothers fault not yours.
Alcoholic or not, you have a right to dictate the kind of behaviour you find unacceptable in your own home. Period.
Part of my recovery was learning about healthy boundaries for myself and learning the importance of insisting on them.
D