Sounds like you may be more afraid of the death of a past dream than fear of a future without him.
But as you astutely pointed out, now that you write it out, it's clear that you were not living a dream, were you? You can't wish away the abuse, or deny it.
Venturing into the unknown as a single parent is scary, but once you know your own power, that transition period should be really short!