Enjoy your child. He sounds amazing.
In my opinion u did an awesome job to have him saying that about his dad. It's because of u that he feels that way. Would u be happy if he was saying all I got from my loser dad was this??? You have done exactly what u were suppose to do as a loving mother.
Stand and be proud.