Welcome. Your post is very moving.
You write,
"Whenever I talk to him I feel guilty."
When the addict isolates us...as he always does....our emotions are at his mercy and he will manipulate them to protect his addiction at all costs. So, he has you just where he wants you: feeling too guilty to set a rock hard boundary, a rock hard emotional bottom line about whether you will live with an active drug addict and allow your daughter to be raised by one.
You will be unable to make good decisions or escape this web without help. Alone, isolated from support, we are unable to fight for ourselves and our children. Addicts are too powerful.
I'm glad you reached out. You need some face to face support with people who really understand the mind games of the addict/codependent marriage. I hope you'll seek a counselor with this expertise or find an Al-Anon or Nar-Anon meeting (family members of drug addicts will probably be better able to set you on course) and attend every week.
I hope things get better. I hope he works a real program.
Do take care. Protect your child.
Bluejay