25 Jul 2012 - Cache Usage Results

OK, so this has taken a bit longer than expected (vacation and homebuying will do that to a guy), but I’ve finally gotten around to looking at (and somewhat analyze) the data!

First, I have to thank everyone (again) who installed the add-on. I know that for some of you, it caused some serious startup and shutdown lag. Everyone can feel free to uninstall whenever you like (I’ve already stopped the data collection server from actually collecting any data, so it’s not providing me with any more information anyway).

Now, for the interesting bits:

Of course, the amount of data that was just re-used isn’t necessarily the most important thing. If you reuse only 128MiB, but happen to visit a lot of new sites, your total cache usage will go up. We don’t want to set our max at 128MiB, because that would cause lots of churn. So now, let’s take a look at some more useful data.

That last point is especially interesting, given that Google has noticed performance issues with a cache larger than 320MiB. See William Chan’s post for more details.

So what’s the end result of all this? So far, nothing. This does give us information to make an (hopefully) intelligent decision in the near future, though. I think it’s safe to say we’ll likely reduce the default max cache size at some point in the future. We have to decide precisely what the new default will be, however, as well as whether we want to make the change in one release (cue the sound of millions of hard disks spinning as they delete massive amounts of unused disk cache entries), or whether we want to spread the “pain” out over 2 or 3 releases.