Don't be afraid to be honest.
He is using substances for intoxication and you are affected by it and don't like it, yes? Let him know and it's up to him to do something about it. Offer support if he acts to end his substance use, but be prepared if he chooses otherwise.
Wish you well