New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 772591 link

Starred by 1 user

Issue metadata

Status: Archived
Owner: ----
Closed: Dec 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

Moblab: suite tests failing with "Power cycle the host with RPM"

Project Member Reported by venkatar...@chromium.org, Oct 7 2017

Issue description

Moblab Version: guado_moblab-release/R60-9592.88.0

Moblab ifno: moblab1.mtv.corp.google.com

Running suite tests failing with "Power cycle the host with RPM" but tests are PASS when ran individually (like firmware_FAFTSetup) 

0/06 16:21:20.947 DEBUG|        dev_server:1047| whether artifact is staged: 'True'
10/06 16:21:20.947 INFO |        dev_server:1167| Finished staging artifacts: build=sand-release/R63-10007.0.0, artifacts=['autotest_packages'], files=, archive_url=gs://chromeos-image-archive/sand-release/R63-10007.0.0
10/06 16:21:20.949 INFO |        server_job:0854| Processing control file
10/06 16:21:20.956 INFO |            repair:0327| Verifying this condition: host is available via ssh
10/06 16:21:20.956 ERROR|            repair:0332| Failed: host is available via ssh
Traceback (most recent call last):
  File "/usr/local/autotest/client/common_lib/hosts/repair.py", line 329, in _verify_host
    self.verify(host)
  File "/usr/local/autotest/server/hosts/repair.py", line 26, in verify
    if host.is_up():
  File "/usr/local/autotest/server/hosts/abstract_ssh.py", line 583, in is_up
    base_cmd=base_cmd)
  File "/usr/local/autotest/server/hosts/abstract_ssh.py", line 557, in ssh_ping
    ssh_failure_retry_ok=True)
  File "/usr/local/autotest/server/hosts/servo_host.py", line 317, in run
    return super(ServoHost, self).run(**run_args)
  File "/usr/local/autotest/server/hosts/ssh_host.py", line 318, in run
    return self.run_very_slowly(*args, **kwargs)
  File "/usr/local/autotest/server/hosts/ssh_host.py", line 292, in run_very_slowly
    scale=0.001):
  File "/usr/lib/python2.7/contextlib.py", line 84, in helper
    return GeneratorContextManager(func(*args, **kwds))
TypeError: SecondsTimer() got an unexpected keyword argument 'scale'
10/06 16:21:20.957 INFO |            repair:0105| Attempting this repair action: Power cycle the host with RPM
10/06 16:21:20.957 DEBUG|            repair:0106| Repairing because these triggers failed:
10/06 16:21:20.957 DEBUG|            repair:0108|     host is available via ssh
10/06 16:21:20.958 ERROR|            repair:0449| Repair failed: Power cycle the host with RPM
Traceback (most recent call last):
  File "/usr/local/autotest/client/common_lib/hosts/repair.py", line 447, in _repair_host
    self.repair(host)
  File "/usr/local/autotest/server/hosts/repair.py", line 91, in repair
    '%s has no RPM connection.' % host.hostname)
AutoservRepairError: 192.168.231.1 has no RPM connection.
10/06 16:21:20.958 INFO |            repair:0105| Skipping this operation: Start servod with the proper config settings.
10/06 16:21:20.958 DEBUG|            repair:0106| The following dependencies failed:
10/06 16:21:20.958 DEBUG|            repair:0108|     host is available via ssh

 
3124-moblab_Failed_From_Suite.tar.gz
11.5 KB Download
3143-moblab_PASS_Individually.tar.gz
44.8 KB Download
Cc: gwendal@chromium.org
Same problem with DUT running R63-10032.17.0 and hardware_storagequal.

5-moblab.tgz
12.2 KB Download
Cc: haddowk@chromium.org
+cc haddowk

Keith, have you seen this?

running a suite should theoretically be exercised during the moblab qual (i.e. it's in the testplan), so not certain what's going on here

Comment 3 by hadd...@google.com, Oct 27 2017

So it can be worked around by using R62 for your DUT, or updating the moblab, working on a stable release on moblab at the moment but I have some build blockers
Components: Infra>Client>ChromeOS
Status: Archived (was: Untriaged)

Sign in to add a comment