Why is he coming over every day? Your kids are 9 and 14, you said the 14-y/o doesn't like having him there. Is there not a neighbor who they could call in case of emergency?
How does it help anyone to come home to him sleeping on the sofa and preparing a crappy, overcooked dinner? Maybe you could ask the kids to do a little of the prep work for the meal so you could have a bit of time to relax when you first walk in the door. They could wash and cut up vegetables, make a salad, set the table or whatever.