He had lost his job and was going to move in with me, but mid-move I had a visceral reaction and knew I couldn’t let him.
Your instincts protected you. Mellybug, way to go in listening to them!
He lost his job. He abandoned his things at your place. His actions. It's completely okay to let go of anything (guilt, fear, his stuff, etc.) that aren't helping you enjoy this beautiful, wonderful day. One day at a time, we get the choice to enjoy life and move forward.
This brings inner confidence.
Inner confidence will eradicate those fears.
All is well. It's just a process.