You look back a little, yes. Sometimes you look back and say, "Thank God I was smart enough to get out of that crazy situation!"
He's not your infant. He's a grown man. The world is full of grown men who are responsible for themselves. Let him be responsible for himself.
Maybe having to take care of himself is exactly what he needs for recovery. Maybe you being there keeps the status quo ...