It's your home, and you set YOUR rules/boundaries.
If it were me, I would absolutely ask him to leave, period. If he wants to drink, he will.. however that doesn't have to be allowed at your home. It IS up to you, what goes on at your house.. He is an adult, and can figure out the rest. We can be very resourceful if we have to.
You might also check out the Friends and Family section of this forum, they're really great at providing support and guidance over there