I have to agree. You are working on YOU right now, and he is definitely not helping you see yourself in a positive light. We all have things in our past. Big deal. We get past them and we make ourselves into who we want to be. It takes time and commitment, and having people in your life who are not helping you do just that is nothing but a hinderence.
Keep working Lacey. You have it in you to be whomever you want to be!