Careful, your codpendency is showing.
Everyone has unkind thoughts about others from time to time. Acting upon those thoughts or not, is the difference between immatiurity and maturity.
His behaviors/choices have consequences.
We all feel lonely from time to time. Being alone is not the same thing as being lonely. Being alone is anything you want it to be. It's your choice.
If you are concerned about him showing up and begging , have a plan. Do not answer the door. If he persists, call the Police. Do not take calls from him or unknown callers. Take responsibibility for your reactions and outcomes.
No reason to let someone like this back into your life, is there?