I would probably suggest NOT turning anything back around on a co-worker, especially if you're new at the job and there's higher-ups there...it can come across as a bit pious and arrogant...
That being said, I'd also say to set yourself a time deadline - if the HH starts at 5:00, plan to be on the road by 6:00 (or whatever). Take initiative in the conversations so you don't feel bored and want to order up. Plan to do something else tonight when you get home...maybe some exercise, like a long walk.
Just my thoughts...