Here's a graph of this data:
https://chromeperf.appspot.com/report?sid=ee72e4fde22773980f4f7959aa5a1ebfd9994c7c877cdbf336c0f6de6009dfbb&start_rev=460440&end_rev=462848

It looks mostly the same? I'm not sure how to read this, can someone else confirm if this looks ok?

Looking at the benchmark duration:
Swarming: 110 minutes on average
Non swarming: 240 minutes on average.
Conclusion: swarming is twice as fast as the non swarming.

timeToFirstContentfulPaint_avg metric:
Swarming: 8s on average
Non swarming: 28-29s on average


timeToFirstContentfulPaint_avg metric:
Swarming: 8s on average
Non swarming: 28-29s on average

cpuTimeToFirstMeaningfulPaint_avg
Swarming:  370ms on average
Non swarming: 429ms on average

So looking at those data, it seems like swarming seem to have a lot less test overhead, which is a good thing.

+ksakamoto: can you help spot check whether the loading traces on Android Swarming devices make sense? (Context: we are trying to move our Android bots for perf lab to swarming,  issue 670879 )

https://chromeperf.appspot.com/report?sid=4b7c9f4b8d007c6417d8031db1c5f2b6ff0c5b78940419feb7df00cb714a7f4a

https://chromeperf.appspot.com/report?sid=f23939c1a37178de432bffb14f3208a6283ab64e4f36f883b0c520eeda3681dc&start_rev=460440&end_rev=462848 is a bit better of a graph to look at than the link I posted in #2.

I've checked a few traces and they looked sane to me.

Examples:

android-nexus5X https://console.developers.google.com/m/cloudstorage/b/chrome-telemetry-output/o/trace-file-id_37-2017-04-07_01-24-07-13531.html
fyi-android-swarming-n5x https://console.developers.google.com/m/cloudstorage/b/chrome-telemetry-output/o/trace-file-id_37-2017-04-09_09-45-21-32120.html

android-nexus5X https://console.developers.google.com/m/cloudstorage/b/chrome-telemetry-output/o/trace-file-id_33-2017-04-07_06-22-01-49857.html
fyi-android-swarming-n5x https://console.developers.google.com/m/cloudstorage/b/chrome-telemetry-output/o/trace-file-id_33-2017-04-06_05-33-31-94308.html

The overall shape looks the same, but swarming is faster.

Thanks ksakamoto@! I mark this bug as verified to confirm that we are happy with loading benchmark on the new bot. Please feel free to reopen this if you find any issue.