least

Your brother may have to leave to save your sanity and sobriety. If he takes it badly that's on him, not you. I agree with setting boundaries and sticking to them. It's your house, after all.