I'm sorry for the reason you came here Meadow. It's easy to become attached to someone as we first find them. Maybe hormones have a lot to do with it. Then when we discover the other side of coin it's too late to reverse our feelings.
Whether he believes deep down in what he's saying or not, he's abusing you. You don't need this in your life, and it will rub off on your son. You may want to consider cutting all contact with him. If that seems drastic, read some of the threads on this forum.
You're caught in a situation where you are facing a choice.