Just because you made a single mistake by contacting him doesn't mean you are obligated to keep it up. Yes, you would be jeopardizing your sobriety (eight years sober here--or will be in a week), and also your sanity and safety.
Let it be done, go back to no contact, and if he persists, explore the possibility of a protective order.