New issue
Advanced search Search tips

Issue 922629 link

Starred by 1 user

Issue metadata

Status: Untriaged
Owner: ----
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 3
Type: Bug



Sign in to add a comment

pantheon: "Unable to find /bin/uname" when running power_LoadTest.1hour

Project Member Reported by tbroch@chromium.org, Jan 16 (6 days ago)

Issue description

Chrome Version: Any
OS: Chrome

What steps will reproduce the problem?
(1) image my pantheon device
(2) then run test_that via

tests="power_Idle power_Standby.fast power_WebGL power_Display.max_brightness power_Display.cabc power_VideoPlayback power_VideoPlayback.sw_decoder power_LoadTest.1hour power_Display"

ip="100.90.1.1"
test_that --fast --autotest_dir ../third_party/autotest/files $ip $tests


What is the expected result?
test passes or at least doesn't have issue finding /bin/uname

What happens instead?
from status.log,

INFO    ----    ----    timestamp=1547198269    job_abort_reason=Unable to find /bin/uname on pantheon_pdb      localtime=Jan 11 01:17:49    Unable to find /bin/uname on pantheon_pdb

This happens 100% of the time for this device but not for other devices on same test or for different tests on same device.

failure occurs in autoserv portion before the test actually executes and appears to be the result of connectivity (wifi) not being established,


01/16 00:54:22.690 DEBUG|             utils:0219| Running '/usr/bin/ssh -a -x -N -o ControlMaster=yes -o ControlPath=/tmp/_au
totmp_nJrYqossh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=
30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22 pantheon_pdb'
01/16 00:54:27.540 ERROR|             utils:2770| Timed out waiting for condition: Wait for a socket file to exist
01/16 00:54:27.541 INFO |     ssh_multiplex:0113| Timed out waiting for master-ssh connection to be established.
01/16 00:54:29.601 ERROR|             utils:0287| [stderr] ssh: connect to host pantheon_pdb port 22: No route to host
01/16 00:54:29.603 ERROR|           factory:0219| Failed to verify connectivity to host. Skipping host auto detection logic.
Traceback (most recent call last):
  File "/mnt/host/source/src/third_party/autotest/files/server/hosts/factory.py", line 216, in create_host
    _verify_connectivity(connectivity_class, hostname, **args)
  File "/mnt/host/source/src/third_party/autotest/files/server/hosts/factory.py", line 156, in _verify_connectivity
    ignore_timeout=False)
  File "/mnt/host/source/src/third_party/autotest/files/server/hosts/ssh_host.py", line 335, in run
    return self.run_very_slowly(*args, **kwargs)
  File "/mnt/host/source/src/third_party/autotest/files/server/hosts/ssh_host.py", line 324, in run_very_slowly
    ssh_failure_retry_ok)
  File "/mnt/host/source/src/third_party/autotest/files/server/hosts/ssh_host.py", line 268, in _run
    raise error.AutoservRunError("command execution error", result)
AutoservRunError: command execution error
* Command: 
    /usr/bin/ssh -a -x  -o ControlPath=/tmp/_autotmp_nJrYqossh-master/socket
    -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpeGVHjd -o
    BatchMode=yes -o ConnectTimeout=4 -o ServerAliveInterval=300 -o
    ServerAliveCountMax=3 -o ConnectionAttempts=1 -l root -p 22 pantheon_pdb "
    if type \"logger\" > /dev/null 2>&1; then logger -tag \"autotest\"
    \"server[stack::create_host|_verify_connectivity|run] -> ssh_run(test
    :)\";fi; test :"
Exit status: 255
Duration: 2.01830601692

stderr:
ssh: connect to host pantheon_pdb port 22: No route to host
01/16 00:54:29.605 DEBUG|           factory:0222| Defaulting to CrosHost.
50%

...

01/16 00:55:44.906 ERROR|         traceback:0013|     host.log_kernel()
01/16 00:55:44.907 ERROR|         traceback:0013|   File "/mnt/host/source/src/third_party/autotest/files/client/common_lib/hosts/base_classes.py", line 540, in log_kernel
01/16 00:55:44.907 ERROR|         traceback:0013|     kernel = self.get_kernel_ver()
01/16 00:55:44.907 ERROR|         traceback:0013|   File "/mnt/host/source/src/third_party/autotest/files/client/common_lib/hosts/base_classes.py", line 494, in get_kernel_ver
01/16 00:55:44.908 ERROR|         traceback:0013|     cmd_uname = path_utils.must_be_installed('/bin/uname', host=self)
01/16 00:55:44.908 ERROR|         traceback:0013|   File "/mnt/host/source/src/third_party/autotest/files/client/common_lib/cros/path_utils.py", line 66, in must_be_installed
01/16 00:55:44.908 ERROR|         traceback:0013|     raise error.TestError(error_msg)
01/16 00:55:44.908 ERROR|         traceback:0013| TestError: Unable to find /bin/uname on pantheon_pdb
01/16 00:55:44.915 ERROR|          autoserv:0810| Uncaught SystemExit with code 1
Traceback (most recent call last):


That is in response to the device typically becoming unresponsive during the previous test,

m /tmp/test_that_results_YjFo0L/results-7-power_VideoPlayback.sw_decoder/status.log 
INFO    ----    ----    kernel=4.4.169-15634-g6da702e55181      localtime=Jan 16 00:07:01       timestamp=1547626021    
START   ----    ----    timestamp=1547626029    localtime=Jan 16 00:07:09       
        START   power_VideoPlayback.sw_decoder  power_VideoPlayback.sw_decoder  timestamp=1547626030    localtime=Jan 16 00:07:10       
                FAIL    ----    ----    timestamp=1547628596    localtime=Jan 16 00:49:56       Autotest client terminated unexpectedly: DUT is no longer pingable, it may have rebooted or hung.
        END FAIL        ----    ----    timestamp=1547628596    localtime=Jan 16 00:49:56       
END GOOD        ----    ----    timestamp=1547628596    localtime=Jan 16 00:49:56       



 

Comment 1 by tbroch@chromium.org, Jan 16 (6 days ago)

Next step to run power_VideoPlayback.sw_decoder on pantheon separately or see if similar failures exist in stainless runs.

Comment 2 by tbroch@chromium.org, Jan 16 (6 days ago)

Test doesn't currently run as part of any suite in lab despite belonging to suite:power_sanity.  May be worth adding to power_daily which does have some coverage in the lab.


Project Member

Comment 3 by bugdroid1@chromium.org, Jan 17 (5 days ago)

Sign in to add a comment