I think you are right just to take it a day at a time. Only you can decide what you want and need, and DESERVE from your marriage. And the only thing that can establish trust, or not, is time. It stinks, but that's a fact.
Keep taking good care of you and your baby!