My guess is that he's trying to be polite. Not intending to hurt you, but not wanting a relationship.
Sweetie, it really doesn't MATTER if he thinks you don't want to be friends. Truly, it doesn't. You are in no position to have a friendship with him at this point. You are too wrapped up in this obsessive thinking to be a good friend to him.
You DO have good friends in your life. You don't need this one. It's OK not to be friends with certain people just because there would be an unhealthy dynamic between the two of you.
Let it go. Let HIM go.