I'm very much affected by the associations I make with my surroundings. I don't think *I* would care to stay in a house that had bad memories--I'd prefer to be in a new place that would make me feel like it's truly my own.
That's me, though. It might make sense from a financial or practical standpoint to stay put. If that's so and it won't bring you down emotionally to stay there, then stay put.