It's a hard call for sure; many of us have been in this position and it's never a clear-cut answer.
However, your decisions for what you do in your life (regarding this issue or any other) shouldn't be so dependent on what he does or doesn't do. You are your own person and you can be sure he ain't taking what you do into his decision-making process.
The book "Co-dependent no more" has a lot of illuminating points on this. Good luck.