To optimize partners running of CTS we need to start the long running test prior to the shorter running test, allowing better utilization of available DUT's and shorter run times.
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/782e2a81bb3640063be943bcb4b0777891aeacb7 commit 782e2a81bb3640063be943bcb4b0777891aeacb7 Author: Keith Haddow <haddowk@chromium.org> Date: Tue Oct 03 00:27:20 2017 [autotest] Add the ability for a test to specify increased priority. When you run a suite all tests are treated equally, when running CTS tests on moblab some tests take much longer than others. By scheduling the long running tests first it is possible to optimize the DUT usage and reduce the time partners are able to provide results to Google, making it easier to keep releases on schedule. BUG= chromium:769086 TEST=ran on moblab, also ran unittests Change-Id: Ic679dac36b920330130d75d5d396296ec4fbc909 Reviewed-on: https://chromium-review.googlesource.com/685831 Commit-Ready: Keith Haddow <haddowk@chromium.org> Tested-by: Keith Haddow <haddowk@chromium.org> Reviewed-by: Dan Shi <dshi@google.com> [modify] https://crrev.com/782e2a81bb3640063be943bcb4b0777891aeacb7/server/cros/dynamic_suite/suite.py [modify] https://crrev.com/782e2a81bb3640063be943bcb4b0777891aeacb7/server/cros/dynamic_suite/fakes.py [modify] https://crrev.com/782e2a81bb3640063be943bcb4b0777891aeacb7/client/common_lib/control_data.py
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/98cf97a7994ee22f8a8417fbb5f636b75f79e32f commit 98cf97a7994ee22f8a8417fbb5f636b75f79e32f Author: Keith Haddow <haddowk@chromium.org> Date: Wed Oct 04 03:01:16 2017 [cts/autotest] Change the default priority and retries Now the JOB_RETRIES is fixed on moblab - dial things back a little because we are doing too many retries. Add PRIORITY to slow jobs, these will be started first reducing the overall time to run, this only works on Moblab. BUG= chromium:769086 TEST=None Change-Id: I626bfc9795926808d5e37873df9925afc85c7939 Reviewed-on: https://chromium-review.googlesource.com/695939 Commit-Ready: Keith Haddow <haddowk@chromium.org> Tested-by: Keith Haddow <haddowk@chromium.org> Reviewed-by: Rohit Makasana <rohitbm@chromium.org> [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsLibcoreTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsWidgetTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsMediaTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsVideoTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsViewTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsCameraTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsNetTestCasesLegacyApi22 [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsMediaTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsHardwareTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsViewTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsGraphics2TestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsAndroidAppTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsSecurityHostTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsBackupTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsMediaStressTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsAppTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsDeqpTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsVideoTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsDeqpTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsCameraTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsHardwareTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsJankDeviceTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsSecurityTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsNetTestCasesLegacyPermission22 [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsGraphics2TestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsAndroidAppTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsSecurityTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsMediaTestCasesPreconditions [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsSecurityHostTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsThemeHostTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsNetTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsDumpsysHostTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsMediaStressTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsJankDeviceTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsWidgetTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsThemeHostTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsServicesHostTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsLibcoreTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsAppTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsServicesHostTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsDumpsysHostTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsMediaTestCasesPreconditions [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsBackupTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsNetTestCasesLegacyPermission22 [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsNetTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.arm.CtsFileSystemTestCases [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsNetTestCasesLegacyApi22 [modify] https://crrev.com/98cf97a7994ee22f8a8417fbb5f636b75f79e32f/server/site_tests/cheets_CTS_N/control.x86.CtsFileSystemTestCases
Comment 1 by bugdroid1@chromium.org
, Oct 3 2017