Hi Mishey
I think our addicts do love us. But its not a normal healthy type of love. Its a type of love which has been uniquely all jumbled up by addiction. Typical notions of love do not apply.
You have only known this guy for about two years. From what I read you have no other entanglements with him - ie marriage, houses, cars, finances, property, or children.
He is a drug addict. He told you to go. His mother told you to go.
I am not trying to be mean here but regardless of how you feel about him please go & don't look back. I know its a bad situation, I know its hard but save yourself before it gets worse - possibly much worse.
Get whatever help you need to save yourself. You dodged a bullet here. I would think very carefully about your future & the future of your daughter before putting yourself back into that line of fire.