Caring about you and caring about controlling you are two different things. From what you've written here, it seems like everything he does is to manipulate you to get HIS needs met. Maybe there's more to the story?
I'm not being a smart aleck here, I'm really asking: What are you getting out of this relationship? What does he do for you (without expecting anything in return)? Does he encourage you to have a full life with interests outside of the relationship?