Drop him like a bad habit. He will most likely get worse as he trys to control your life. And make no mistake...thats where he is heading. He wants you to yeild to his demands, dictate who you see, who you talk too.
Then once he has you cut off from friends and family.....he will move to physical abuse.
So get out while you still can. Find someone who will treat you like you deserve to be treated.