Sorry you are in this sad situation my dear, and will keep you in my prayers.
I would allow supervised visits by your husband, IF HE IS SOBER, and I would even go as far as to have a reliable friend be with you.
My daughter had Post-Natal depression, but that did not impress her now ex, who just kept being as big a pig to her, and puffed pot as soon as he got home. He almost drove her to suicide....but thank God...she called her sister in time.
I hope you can get some legal advice to ease your mind, but I urge you to before all else, go and see your GP and tell them how you feel re PND, and what is happening in your marriage. You could also contact Domestic Violence agencies because what your husband is doing to you, is abuse.
God bless