Welcome to SR, though I am sorry for what brings you here.
Originally Posted by
j2014 
...or 2) Do I stay with him and be a support while he pursues recovery again.
You've been with him for while, 3 1/2 years, and I assume supporting him. So how has that been working? Not to good, huh?
So you need to remove option 2, or come up with a new one.
Personally, I think you've dodged a bullet. And even though I am sure it doesn't feel like it now, you will be glad you didn't marry a heroin addict. We have an active friends and family forum. Pop over there and read what married life with an addict can be like:
Friends and Family of Substance Abusers - SoberRecovery : Alcoholism Drug Addiction Help and Information