It would be wise to listen to what he's saying. If HE knows you deserve better you have his blessing to move on. Yes, it hurts like hekk but you can be alone and Good.
If you don't love yourself no one else can.
You deserve to love yourself. Put your feelings first. No one else will.
With gentle kindness.