Yep, right now is the best time. That way he will be trying to recover for himself, not you.
I am not good a point blank either. I tell my A in a nice way alot. Sometimes when he is crappy I tell him in a bad way. I hope he gets the picture but just when I think he does, he crawls back to his Mr. Nice guy - I want something from you self.
The thing is with me, my A knows it is over. He is just looking for a morsel of hope here and there that it might not be. I try to be very precise when I tell him I like being alone, I am happy he is doing well for himself, I tell him I pray for him to learn to be comfortable with himself. I leave "us" out of the equation.
Last conversation I had with him he claimed it was over and blamed it on me. I agreed and said that was fine, I would take the blame.
Do your best. It really is hard but remind yourself it is the best for him as well (for his recovery) and you will feel better about it. Hope I made a little sense here. B