You established a healthy boundary for yourself. Our boundaries are only as solid as our willingness to enforce them.
First off, get yourself checked out for STDs. Crack and sexual transgressions go hand in hand. " True Confessions" are always highly edited versions of what's really going on. Addiction demands he protect and sustain it. That you can smell it, tells me his smokes his dope. There are many other ways of using besides smoking and you can't smell it.
Those with an opiate addiction seem highly prone to accidents and physical issues that require pain medication.It's a red flag. Failure to take responsibility is immature and the basis for addiction, not recovery.
Sounds like he shirked all responsibility for his own sobriety and put you in charge of keeping him clean. Being a warden is not a sound basis for a relationship.
Being a convicted felon, in active addition and failure to take full responsibility for his own sobriety does not sound like someone who is an ideal candidate for fatherhood. Parenthod does not cure addiction.
We codependents often fall in love with the hopeful fantasy of the man he could be, if only.....