If you're having doubts, I wouldn't go. Simple as that. This early in your recovery, you need to ensure that all the odds are stacked in your favor for success. It sounds like this trip would definitely pressure you to return to your old habits, and I sincerely doubt you're equipped at this point to handle those pressures. I know I wasn't at 2 weeks. Put yourself and your sobriety first! It's the only way forward.
Best of luck on your journey.