This is way out of my experience Lisa so my remarks should be taken in that light.
There seems to be a disconnect there between wanting kids and not wanting sex.
If it was me I'd want to sort that out?
Maybe, like scott suggests, if talking to your husband is difficult, some counselling would help?
Wishing you all the very best
D