New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 725601 link

Starred by 1 user

Issue metadata

Status: Archived
Owner:
Closed: Jun 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Feature



Sign in to add a comment

Allow partner to run subset of the CTS/GTS suites

Project Member Reported by haddowk@chromium.org, May 23 2017

Issue description

For faster retries partners should not have to re-run the full suite, but when running a suite should be allowed to specify a list of tests in the suite to re-try

 
Project Member

Comment 1 by bugdroid1@chromium.org, May 24 2017

Labels: merge-merged-release-R59-9460.B
The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/5ec19d7f1d593e4e74ccbacbd54a8250a4a3c7e5

commit 5ec19d7f1d593e4e74ccbacbd54a8250a4a3c7e5
Author: Keith Haddow <haddowk@chromium.org>
Date: Wed May 24 16:15:35 2017

[autotest] Change the public cts/gts to allow test to be specified.

Users when creating a new suite can optionally pass in a list of
tests.  Rather than schedule all the tests in the suite the suite
will consist of just the tests in the suite that the user specified.

This allows quicker re-runs of failing tests by partners on moblab.

TEST=tested locally on moblab.
BUG= chromium:725601 

Change-Id: I076084847a28ddc1bea52cb43e49a3edf8efad16
Reviewed-on: https://chromium-review.googlesource.com/513602
Reviewed-by: Keith Haddow <haddowk@chromium.org>
Reviewed-by: Michael Tang <ntang@chromium.org>
Commit-Queue: Keith Haddow <haddowk@chromium.org>
Tested-by: Keith Haddow <haddowk@chromium.org>

[modify] https://crrev.com/5ec19d7f1d593e4e74ccbacbd54a8250a4a3c7e5/test_suites/control.cts_N
[modify] https://crrev.com/5ec19d7f1d593e4e74ccbacbd54a8250a4a3c7e5/test_suites/control.gts

Project Member

Comment 2 by bugdroid1@chromium.org, May 24 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/7e074d58ef0b2f3db398db9e8972824fc5a9f4ad

commit 7e074d58ef0b2f3db398db9e8972824fc5a9f4ad
Author: Keith Haddow <haddowk@chromium.org>
Date: Wed May 24 21:24:04 2017

[autotest] Change the public cts/gts to allow test to be specified.

Users when creating a new suite can optionally pass in a list of
tests.  Rather than schedule all the tests in the suite the suite
will consist of just the tests in the suite that the user specified.

This allows quicker re-runs of failing tests by partners on moblab.

TEST=tested locally on moblab.
BUG= chromium:725601 

Change-Id: I076084847a28ddc1bea52cb43e49a3edf8efad16
Reviewed-on: https://chromium-review.googlesource.com/513007
Commit-Ready: Keith Haddow <haddowk@chromium.org>
Tested-by: Keith Haddow <haddowk@chromium.org>
Reviewed-by: Ilja H. Friedel <ihf@chromium.org>
Reviewed-by: Keith Haddow <haddowk@chromium.org>
Reviewed-by: Rohit Makasana <rohitbm@chromium.org>
Reviewed-by: Michael Tang <ntang@chromium.org>

[modify] https://crrev.com/7e074d58ef0b2f3db398db9e8972824fc5a9f4ad/test_suites/control.cts_N
[modify] https://crrev.com/7e074d58ef0b2f3db398db9e8972824fc5a9f4ad/test_suites/control.gts

Project Member

Comment 3 by bugdroid1@chromium.org, May 25 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/5aaef184ff6f1427c536545a407b14a46f13b24f

commit 5aaef184ff6f1427c536545a407b14a46f13b24f
Author: Keith Haddow <haddowk@chromium.org>
Date: Thu May 25 16:35:53 2017

[moblab] Add new featutre to run suite to limit the tests run.

When partners re-run a CTS suite they often just want to run a
subset of the jobs.  The UI now lets you specify a list of test
names.  The suite will only run the tests that are in the suite
and in the specified list.

Demo on http://100.107.3.16/moblab_setup

TEST=local moblab
BUG= chromium:725601 

Change-Id: I7708d2f4765370bff130e224dd0d33854202f6fd
Reviewed-on: https://chromium-review.googlesource.com/514365
Reviewed-by: Keith Haddow <haddowk@chromium.org>
Reviewed-by: Jinsong Mu <jinsong@google.com>
Commit-Queue: Keith Haddow <haddowk@chromium.org>
Tested-by: Keith Haddow <haddowk@chromium.org>

[modify] https://crrev.com/5aaef184ff6f1427c536545a407b14a46f13b24f/frontend/client/src/autotest/public/moblabsetup.css
[modify] https://crrev.com/5aaef184ff6f1427c536545a407b14a46f13b24f/frontend/client/src/autotest/moblab/rpc/MoblabRpcHelper.java
[modify] https://crrev.com/5aaef184ff6f1427c536545a407b14a46f13b24f/frontend/client/src/autotest/moblab/SuiteRunnerView.java
[modify] https://crrev.com/5aaef184ff6f1427c536545a407b14a46f13b24f/frontend/afe/moblab_rpc_interface.py

Project Member

Comment 4 by bugdroid1@chromium.org, Jun 1 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/9857f8754fddad14c578fc8f5615ff233c8612cc

commit 9857f8754fddad14c578fc8f5615ff233c8612cc
Author: Keith Haddow <haddowk@chromium.org>
Date: Thu Jun 01 04:14:35 2017

[moblab] Add new featutre to run suite to limit the tests run.

When partners re-run a CTS suite they often just want to run a
subset of the jobs.  The UI now lets you specify a list of test
names.  The suite will only run the tests that are in the suite
and in the specified list.

Demo on http://100.107.3.16/moblab_setup

TEST=local moblab
BUG= chromium:725601 

Change-Id: I7708d2f4765370bff130e224dd0d33854202f6fd
Reviewed-on: https://chromium-review.googlesource.com/514247
Commit-Ready: Keith Haddow <haddowk@chromium.org>
Tested-by: Keith Haddow <haddowk@chromium.org>
Reviewed-by: Jinsong Mu <jinsong@google.com>
Reviewed-by: Keith Haddow <haddowk@chromium.org>

[modify] https://crrev.com/9857f8754fddad14c578fc8f5615ff233c8612cc/frontend/client/src/autotest/public/moblabsetup.css
[modify] https://crrev.com/9857f8754fddad14c578fc8f5615ff233c8612cc/frontend/client/src/autotest/moblab/rpc/MoblabRpcHelper.java
[modify] https://crrev.com/9857f8754fddad14c578fc8f5615ff233c8612cc/frontend/client/src/autotest/moblab/SuiteRunnerView.java
[modify] https://crrev.com/9857f8754fddad14c578fc8f5615ff233c8612cc/frontend/afe/moblab_rpc_interface.py

Project Member

Comment 5 by bugdroid1@chromium.org, Jun 7 2017

Labels: merge-merged-release-R60-9592.B
The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/f224056428db985cd9836e5be132dbae5b230425

commit f224056428db985cd9836e5be132dbae5b230425
Author: Keith Haddow <haddowk@chromium.org>
Date: Wed Jun 07 16:53:47 2017

[moblab] Add new featutre to run suite to limit the tests run.

When partners re-run a CTS suite they often just want to run a
subset of the jobs.  The UI now lets you specify a list of test
names.  The suite will only run the tests that are in the suite
and in the specified list.

Demo on http://100.107.3.16/moblab_setup

TEST=local moblab
BUG= chromium:725601 

Change-Id: I7708d2f4765370bff130e224dd0d33854202f6fd
Reviewed-on: https://chromium-review.googlesource.com/514247
Commit-Ready: Keith Haddow <haddowk@chromium.org>
Tested-by: Keith Haddow <haddowk@chromium.org>
Reviewed-by: Jinsong Mu <jinsong@google.com>
Reviewed-by: Keith Haddow <haddowk@chromium.org>
(cherry picked from commit 9857f8754fddad14c578fc8f5615ff233c8612cc)
Reviewed-on: https://chromium-review.googlesource.com/526740

[modify] https://crrev.com/f224056428db985cd9836e5be132dbae5b230425/frontend/client/src/autotest/public/moblabsetup.css
[modify] https://crrev.com/f224056428db985cd9836e5be132dbae5b230425/frontend/client/src/autotest/moblab/rpc/MoblabRpcHelper.java
[modify] https://crrev.com/f224056428db985cd9836e5be132dbae5b230425/frontend/client/src/autotest/moblab/SuiteRunnerView.java
[modify] https://crrev.com/f224056428db985cd9836e5be132dbae5b230425/frontend/afe/moblab_rpc_interface.py

Status: Fixed (was: Assigned)

Comment 7 by dchan@chromium.org, Jan 22 2018

Status: Archived (was: Fixed)

Sign in to add a comment