Omm,
First take a deep breath and try to stay calm. If you don't want to see him DON'T. Leave his things on the porch, with a note saying you don't want him there and don't want to speak to him. I would try to have someone there with you when you think he will come. This way you won't have to speak to him. When you have the back door lock fix if you can why don't you change the locks on the other door(s). This way you know he can't get in. If he causes a scene pick up the phone and call 911. I'm sure he would not want the police there if he is using.
Remember to take care of you, keep working on you. don't worry about sounding needy we all have been the same way. It is normal when you are dealing with an addict.
Hugs and prayers coming to you