Have you gone to reconciliation? I was away from the church for 30 years and did a lot of drugs, my drinking had got out of hand. I had totally lost my moral compass. So when I returned to the church, I had a lot of guilt for what I did. But the sacrament of confession let me start fresh with God's forgiveness.
As for all the emphasis on unworthyness in the Bible...is it in the book? Is that really the subject of discussion? Or are you bringing it to the table with what's in your heart?
Peace, Nirvana.