New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 821966 link

Starred by 1 user
Status: Fixed
Owner:
█ mattmallett@chromium.org
Last visit > 30 days ago
Closed: Mar 2018
Cc:
haddowk@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 3
Type: Feature



Sign in to add a comment

Create a short test that will verify moblab and DUTs are setup for CTS

Project Member Reported by mattmallett@chromium.org, Mar 14 2018 
CTS suite will run even if it doesn't have the minimum number of DUTs or is missing required labels. This creates a wasted run for partners because they are missing tests.

Create a simple autotest that will verify the CTS suite requirements:
5 live DUTs
At least one DUT has label 'lighting'
At least one DUT has label 'noloopback'

Partners can run this test prior to running CTS to have more confidence that their moblab is set up correctly. This test can be used as a template for other long running tests, like storage qual.
Project Member

Comment 1 by bugdroid1@chromium.org, Mar 20 2018 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/cbf08f2b3782c07b3c543a7d489d32382d7c9023

commit cbf08f2b3782c07b3c543a7d489d32382d7c9023
Author: Matt Mallett <mattmallett@chromium.org>
Date: Tue Mar 20 00:04:57 2018

[moblab] Create a moblab_setup test for CTS

Create a test and suite that will test that this moblab has
the correct configuration to run CTS, preventing wasted runs
for incorrect setups. The suite is runnable from moblab Run Suite
page.

BUG= chromium:821966 ,  chromium:785067 
TEST=Run the new suite and verify all code paths work

Change-Id: I7ae0af8b9042da6b94a90d83b969412946588319
Reviewed-on: https://chromium-review.googlesource.com/963504
Commit-Ready: Matt Mallett <mattmallett@chromium.org>
Tested-by: Matt Mallett <mattmallett@chromium.org>
Reviewed-by: Keith Haddow <haddowk@chromium.org>

[add] https://crrev.com/cbf08f2b3782c07b3c543a7d489d32382d7c9023/server/site_tests/moblab_Setup/control.cts_N
[modify] https://crrev.com/cbf08f2b3782c07b3c543a7d489d32382d7c9023/site_utils/attribute_whitelist.txt
[modify] https://crrev.com/cbf08f2b3782c07b3c543a7d489d32382d7c9023/frontend/client/src/autotest/moblab/SuiteRunnerView.java
[add] https://crrev.com/cbf08f2b3782c07b3c543a7d489d32382d7c9023/server/site_tests/moblab_Setup/moblab_Setup.py
[add] https://crrev.com/cbf08f2b3782c07b3c543a7d489d32382d7c9023/test_suites/control.moblab_setup
Project Member

Comment 2 by bugdroid1@chromium.org, Mar 20 2018 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/728138d9563d69fc3eb3efa6e3dc93d3b111652a

commit 728138d9563d69fc3eb3efa6e3dc93d3b111652a
Author: Matt Mallett <mattmallett@chromium.org>
Date: Tue Mar 20 19:16:07 2018

[moblab] Create a moblab_setup test for CTS

Create a test and suite that will test that this moblab has
the correct configuration to run CTS, preventing wasted runs
for incorrect setups. The suite is runnable from moblab Run Suite
page.

BUG= chromium:821966 ,  chromium:785067 
TEST=Run the new suite and verify all code paths work
CQ-DEPEND=CL:963504

Change-Id: Iebfdab44e212c9b21e6b87c8a106bc731a1ba34c
Reviewed-on: https://chromium-review.googlesource.com/963505
Commit-Ready: Matt Mallett <mattmallett@chromium.org>
Tested-by: Matt Mallett <mattmallett@chromium.org>
Reviewed-by: Keith Haddow <haddowk@chromium.org>

[modify] https://crrev.com/728138d9563d69fc3eb3efa6e3dc93d3b111652a/chromeos-base/autotest-server-tests/autotest-server-tests-9999.ebuild

Comment 3 by mattmallett@chromium.org, Mar 20 2018

Status: Fixed (was: Started)
►

Sign in to add a comment