I will never encourage or advise someone to end their marriage. Those kinds of decisions are personal, and none of us on this side of the screen can know the situation as you do.
If she is always feeling judged by you and you are always walking on eggshells around her, then perhaps that is a conversation that needs to be had at the very least. Whether or not it is something worth working on together is something for you to decide. If it's not, then it is not fair to either of you going forward.