But if this is what you have:
"He's not physically abusive, he's not verbally abusive as in yelling and calling names, but the little put downs, the know-it-all attitude, the lack of love and caring, the complete lack of being there for me really weigh me down."
What would you be throwing away?
I don't think you sound like you have a big head, but I think you sound confused. On the one hand you say you he doesn't deserve you and you KNOW you deserve better, but on the other you say you're willing to accept status quo.
I hope one day you'll really believe that he doesn't deserve you and you deserve better. Because right now, all it appears to be is talk.