Okay, a few thoughts in response :-)
You can always keep working with your hands in your spare time for fun. You wouldn't have to eradicate it from your life entirely.
You might be surprised how a bit of maturity helps when returning to academic life. I started (again) when I was about your age. Did it part time for the most part, and just finished up last year in my late forties. True, my memory wasn't as flash as it was when I was younger, but I had the advantage of life experience, and a fresh appreciation of the pure thrill of learning. I loved it, and I had been really inattentive at secondary school. Don't wait to believe in yourself. Just do it anyway. I bet deep down when you really think about it, there is some occupation that stirs your spirit and excites you.