Hi Gem, I feel a little like you, in that I've just had a final break with a long-term friend, my daughter has made it clear she has no time for me at the moment and I'm feeling pretty depressed. Not about me though, just to say I understand a little of how you feel.
I was wondering if there are forums or meetings for people in your situation, maybe not physical challenges but with v little spare cash? Dare I suggest a church, because I know they are big in the US, and have lots of side activities? As an atheist I wouldn't go to one myself, but that doesn't apply to everyone.
I had 2 years unemployed, so I know how difficult it can be keeping up with people who have money. I did manage in other ways but making them little food gifts, or helping with babysitting, or finding meaningful tokens for them second hand. As long as I was doing something, I didn't feel it was too uneven.