Refactoring it too darn fun. Stop it!
I agree (see refactoring is not free) with the opinion that refactoring, under certain circumstances, is waste. Whether refactoring is a necessary waste depends on how likely it is that a particular piece of code will change in the future. Do not refactor code that will never change. You will never get a payback other than that it makes you feel good for a moment. You should refactor when you see the opportunity to diss fellow developers though ;)