One thing I've learned about myself is I can use just about any excuse to justify my actions, or lack of. I doubt it's about the house. I used my kids as my excuse to stay. It wasn't about them either. It was about me and my fears. Until the pain of staying outweighs the fear of change, there will be no change.
JMHO,
L
P.S. There are two ways to get to that point. Work on overcoming the fear, or stick around for more pain.