I didnt go through detox, but am part of AA. Our meetings are often funny & happy, we spend time outside meetings having fun, and we build friendships that are a balance of a support network & just happy, healthy friendships.
I wonder why you think that the purpose of getting contact info is to use together. I'm sure some folks relapse together, but in many, many years of being involved in sobriety I have NEVER had another member call me to suggest that we take drugs or drink together!
I would suggest that you talk about this discomfort in your support group (Alanon,etc). Your man will need to build sober friendships to stay sober, and you'll have to find some way to feel safe as he does so. In early sobriety, quite a bit of time will be dedicated
to fellowship. Some of it will be fun & joyous for him. You will have to create joy in your own life & build social circles that make you happy so that this doesn't make you feel left out. (equalize the fun!)