New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 688261 link

Starred by 2 users

Issue metadata

Status: Archived
Owner:
Last visit > 30 days ago
Closed: Apr 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Feature



Sign in to add a comment

Autotest: Create a wifi_matfunc_noservo suite

Project Member Reported by kirtika@chromium.org, Feb 3 2017

Issue description

Some of the devs on Chrome OS team have wificells and would like to run wifi_matfunc on them. However, wifi_matfunc includes servo-dependent tests such network_WiFi_SuspendStress and network_WiFi_WakeOnWiFiThrottling. 

It doesn't seem like there exists a way to tell autotest - "hey run all the tests in this suite except for the ones that need servo".
The --enforce-deps parameter was created for precisely this reason - it's intent is to skip all tests who dependencies cannot be met. In this unfortunate case though, --enforce-deps is no good since it will skip all the tests. 'wificell' is a dependency in the entire suite and it cannot be detected, so --enforce-deps skips anything with that dependency. 

As a result, the only solution I can think is the sloppy and non-maintainable one - create a new suite that has all wifi_matfunc tests except those that need servo, and hope that the two suites (wifi_matfunc and wifi_matfunc_noservo) will somehow stay in sync in the future. 


 
Project Member

Comment 2 by bugdroid1@chromium.org, Mar 30 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/cfc4394dc7283dcd3d86e812de461006e56c372c

commit cfc4394dc7283dcd3d86e812de461006e56c372c
Author: Kirtika Ruchandani <kirtika@chromium.org>
Date: Thu Mar 30 21:03:44 2017

[autotest] Add wifi_matfunc_noservo

This allows running the subset of wifi_matfunc that does not
need a servo. Several folks on the dev team use wificells
and would like to run wifi_matfunc, but cannot mandate a servo
on each device they work with.

BUG= chromium:688261 
TEST=Ran locally with
`python test_that.py -b reef testbed3 suite:wifi_matfunc_noservo --autotest_dir=../ --fast`

Change-Id: I4d7b83c420417fe57c4a5d050c885c59ddf26372
Reviewed-on: https://chromium-review.googlesource.com/436846
Commit-Ready: Ilja H. Friedel <ihf@chromium.org>
Tested-by: Kirtika Ruchandani <kirtika@chromium.org>
Reviewed-by: Ilja H. Friedel <ihf@chromium.org>

[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkDFS
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_DisconnectReason/control.ap_gone
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SecChange/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check1x_WPA
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check5HT20
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkOddWPAPassphrases
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check11g
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_Roam/control.wifi_roamWPA
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check11a
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_Roam/control.wifi_roamWEP
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check1x_TTLS
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkTruncatedBeacon
[add] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/test_suites/control.wifi_matfunc_noservo
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_ConnectionIdentifier/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_RateControl/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check5VHT80
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_Reassociate/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_DisconnectReason/control.disable_client_wifi
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_IBSS/control.wifi_IBSS
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkHiddenWEP
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_MaskedBSSID/control.wifi_masked_bssid
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkWPA2
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkWPA_multi
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_LowInitialBitrates/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkWEP104
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkHidden
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkSSIDLimits
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_ChannelScanDwellTime/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_BgscanBackoff/control.wifi_bgscan_backoff
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_DisconnectClearsIP/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkWPA_TKIP
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_Regulatory/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/client/site_tests/network_WlanDriver/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_ProfileBasic/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check24HT40
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_Roam/control.wifi_roam1xTLS
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_RxFrag/control.wifi_rxfrag
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkHiddenWPA
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_LinkMonitorFailure/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_ProfileGUID/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_MissingBeacons/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_HiddenRemains/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_ScanPerformance/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkWPA2_TKIP
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_PTK/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_DTIMPeriod/control.wifi_DTIM_period
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check11b
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_VisibleScan/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_GTK/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_CSADisconnect/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkWPA_CCMP
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_MalformedProbeResp/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SetOptionalDhcpProperties/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_DisconnectReason/control.ap_send_chan_switch
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkRawPMK
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_BeaconInterval/control.wifi_bintval
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_PMKSACaching/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkWEP40
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkWPA2_PMF
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check24HT20
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check1x_WEP
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_HiddenScan/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkNonAsciiSSID
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_Roam/control.wifi_roamNone
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_DisconnectReason/control.deauth_client
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_DisconnectReason/control.switch_ap
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_TDLSPing/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check5HT40
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_checkMixedWPA
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_OverlappingBSSScan/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_SimpleConnect/control.wifi_check1x_PEAP
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_MultiAuth/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_Powersave/control.wifi_ps
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_RoamDbus/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_Prefer5Ghz/control
[modify] https://crrev.com/cfc4394dc7283dcd3d86e812de461006e56c372c/server/site_tests/network_WiFi_DisableEnable/control

Labels: OS-Chrome
Status: Fixed (was: Assigned)
Fixed, right?

Comment 4 by dchan@google.com, May 30 2017

Labels: VerifyIn-60

Comment 5 by dchan@chromium.org, Aug 1 2017

Labels: VerifyIn-61

Comment 6 by dchan@chromium.org, Jan 22 2018

Status: Archived (was: Fixed)
Cc: -yoshi@chromium.org

Sign in to add a comment