I used to have severe confidence issues to in part to an abusive relationship, i had therapy which helped me no end. I stayed single for 5 years, before meeting AEXBF who managed to very quickly strip away my self confidence once again (especially after ending it to find out that he targets women with good jobs - basically meal tickets - that cut me)!, after I ended the relationship and sat down and looked at things logically - I realised that it was he who had no self confidence I acutally had more than I thought - hence why I was able to walk away relatively quickly and I am determined to stay away - 5 years ago I would have hung in there for years and years but I realise that whilst I desparately still want him to regain sobriety and be happy (on some level I still love him) - my happiness is more important to me and to my family friends and loved ones, and really thats the way it should be.
You are important, and what you want is important, put yourself first if only for a while.