Ya...those first few weekends are hard.
If it makes you feel any better I can tell you that they no longer bother me in that way. I really look forward to getting home to see my kids. I might watch a movie or maybe even go out for some night photography in Toronto. And even if I stay out late I'll still be up bright and early the next morning and feeling great.
So hang in there....it does get easier and easier.