Just as you might with your son, you should consider yourself a single mom to the dog. It sucks, I know, but if you have the same low expectations you might not be let down so much, plus you will likely have a better dog for it.
Is there anyone else who could care for him when you are out. If you are gone days maybe a doggie daycare or kennel would work.