Please bear in mind what Ivanmike said. I don't believe you would have continued smoking pot if there wasn't some feel good factor in it. Why would you?
The fact is you have now dropped both drugs and alcohol, and you are going to feel a little raw to say the least without your chemical friends to ease the discomfort of living sober.
Your partner sounds a bit of a clown, but he doesn't have the power to make you use again if you are committed to doing whatever it takes to stay clean and sober. And we'll support you on that.