From svn:

…remember that performance optimization is never about the optimal, it’s about the good enough. Performance is a problem when it’s a problem, but otherwise it’s just not relevant.

Recently I had to tweak a site to perform a little bit faster… in the end the gain was not that much, but just taking a look and improving a bit is often all it’s needed.