I HATE driving in any city. You are not alone there.
Not sure of your situation but if you can hold out for something less stressful its probably for the best.
At least you did the right thing by telling them you didnt want the job. Possibly saved them a lot of time if they were gonna offer you the job just to have you decline. Good on you for that.
Keep looking my freind. There is a seat for every a$$