This is a little game I play in these scenarios: substitute marijuana for booze and imagine you've given pot up but your guests still enjoy it. In this case would you supply some marijuana for the party? Likely not.
I agree with the other posters, make it BYOB, or just leave it off the menu. I get really tempted when we have BBQs with beer at my place!