I don't know if I can handle the guilt of their father not wanting to be with them bc of me.
This is not a reason for you to feel guilt. He has a responsibility for the kids regardless if you are together or not.
On your questions, there is no way for me to answer. Just put yourself and the kids first.