I'm guessing that most of your anxiety is because you feel to some extent that you are dependent on him: housing, money etc.
The best thing you can do for yourself is to become self reliant. When I looked at all my anxieties and fears I saw that I was afraid because I was dependent on my AH financially.
The best solution to this situation is to get a plan to be self supporting. Find a relative that can take you in. Find a job and work so you can support yourself and your child to the best of your abilities. Go to school if you need to, but do something that will make you a person on your own.
Even if you have to go to your parents, you can make it low stress for them, but it will take some work on your part. This might mean no contact with your ex, taking responsibility for child care and helping to maintain the home.
Be good to yourself!