Pookie, carefully investigate the options from a financial angle; how much will refinancing cost, real estate outlook, maintenance costs, payment levels and so on, factoring in the chance of an interest rate rise.
Once you have a clear picture of the financial implications of both options you can make your decision based on emotion, but fully informed. Don't forget to plan very carefully for your financial future right up to retirement, even if you're young.