I just saw  bug 840504 . It looks like the reason this wasn't caught earlier is that the perf sheriff did not file a bug because the mean_pixels_checkerboarded metric is not monitored for smoothness benchmarks. Should it be?