LOL! Yes you could be in a bigger freakin mess...this is small potatoes here WTBH. Not to minimize your feelings about it but girl, you are human and like a boy. That's not the issue.
The real issue here is the current mess you are in, the safety of you and your girls, and would introducing this man to that be fair? Probably not. Not yet, at least.
Can you have a friendly relationship with him for now? Sure. Keep the attraction at bay...well he can be your fantasy man for a while...but until the ink is dry on the divorce papers and the crazy AH is off to harass other unsuspecting women, for this new man's sake and for yours, don't let him get dragged into anything. Not yet.
Your post makes me smile. It's ok to like other people, men included. Especially men who are kind, fun, and attractive. And at least you have a little brightness in your life right now, ya know? Enjoy the flirtation.