It's obvious to me that he doesn't want to be "just friends." This puts the whole concept of being his friend in a precarious spot. And, I must say that in all my 48 years, I have never successfully managed to "remain" friends with someone I had a romantic relationship with. I have reconnected, after a period of time, and became friends with a couple old flames, but never made the transition straight from lover to friend. I especially cannot see it happening with someone who doesn't want to break up in the first place.
Ultimately, you have to decide if you want this man in your life or not. If not, then let him go--completely. There is no rule that you could not get back together at some point in the future, IF he manages to sort himself out. But, that's a BIG IF.
L