Determine device coverage for Render Tests |
||
Issue descriptionCurrently Render Tests have goldens for Nexus 5s and Nexus 5Xs. The Testers have both of these devices but the Trybots only use Nexus 5s. For Render Tests to be useful, we'd want to be able to catch all regressions on the Trybots. Additionally, downloading the updated goldens won't be as useful if it only provides you goldens for some of the devices. Apparently Trybots may gain some Nexus 5Xs? Figure out what devices we want to store goldens for. Potentially remove goldens for Nexus 5Xs until Trybots get them.
,
Jun 9 2017
@jbudorick, just to check, we also have both Nexus 5s and Nexus 5Xs running instrumentation tests on the Testers/Builders?
,
Jun 9 2017
on the CQ, yep. We have additional hardware on CI, e.g. N7v2s on chromium.android, but not on the CQ. Notably, though, we don't have chrome_public_test_apk running on the N5X CQ bot yet.
,
Jun 9 2017
OK, as a summary: On the CQ: Nexus 5 - linux_android_rel_ng Nexus 5X - android_n5x_swarming_rel, this does not yet run chrome_public_test_apk ( Issue 731759 ). On the CI: Nexus 5 - https://build.chromium.org/p/chromium.linux/builders/Android%20Tests Nexus 5 - https://build.chromium.org/p/chromium.linux/builders/Android%20Tests%20%28dbg%29 Nexus 5X - https://build.chromium.org/p/chromium.android/builders/Marshmallow%2064%20bit%20Tester |
||
►
Sign in to add a comment |
||
Comment 1 by jbudorick@chromium.org
, Jun 7 2017