Sorry to be short and to the point here but he gave you the answer.
Tell him you don't love him...then he will leave and you can mop up the mess!
I know this is very very difficult but at the end of the day you need to decide what is best for you and your kids.....then act. You can't wait for him to go along willingly and happily....just won't happen.