No one can answer this question without running your numbers. If you have a high rate, get rid of it. you can even borrow with no closing costs by raising the rate.
No one has any idea when the next recession is, how bad it will be and what rates will drop to.
They are pretty good right now hovering around 4. The low during the last recession was 3.375%.