Why does every decision have to be the 'end of the world as we know it' or 'life altering to the point that things will never be the same again?' So what if you spend a thousand dollars to refinance and then decide later on to sell the house anyway. So what. If you're saving a couple hundred a month in payments, you will have broken even in 5 months. You're going to decide to stay with him forever based on saving $1000?
Step back, look at what you just typed. This is not about the house, or the money. This is you trying to justify a decision that you are afraid to make based solely upon it's own merits. Maybe you should ask yourself why you are doing that.
L