So what I gather is that if I'm not planning on staying in my house for around 3 more years, it's really not worth refinancing?
Absolutely not worth it unless your current rate was through the roof. I plugged in my mort. on this calc and depending on my tax rate, it would take 5-7 years just to break even if the new rate was 4.5%
http://usaa.mortgagewebcenter.com/R...Calculator.asp?Q1393=MortgageRefinance&PID=78