Refactoring is good. It can be rather scary to run into a piece of code that's been around for a few years (although the comments with it can be worse). If you improve the pieces of your system even half of the times that you need to tweak them, you're going to be in pretty good shape.