New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 713845 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 714259
Owner: ----
Closed: Apr 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

Test failed at Rsync failures

Project Member Reported by nxia@chromium.org, Apr 20 2017

Issue description

https://uberchromegw.corp.google.com/i/chromeos/builders/x86-zgb-paladin/builds/9663

https://pantheon.corp.google.com/storage/browser/chromeos-autotest-results/113515254-chromeos-test/chromeos6-row2-rack6-host22/debug/

04/20 12:09:48.010 DEBUG|      abstract_ssh:0357| Using Rsync.
04/20 12:09:48.011 DEBUG|        base_utils:0185| Running 'rsync -l  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_KcZBYossh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos6-row2-rack6-host22:"/usr/local/autotest/results/default/" "/usr/local/autotest/results/113515254-chromeos-test/chromeos6-row2-rack6-host22"'
04/20 12:09:48.591 WARNI|      abstract_ssh:0387| trying scp, rsync failed: Command <rsync -l  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_KcZBYossh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos6-row2-rack6-host22:"/usr/local/autotest/results/default/" "/usr/local/autotest/results/113515254-chromeos-test/chromeos6-row2-rack6-host22"> failed, rc=23, Command returned non-zero exit status
* Command: 
    rsync -l  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp
    /_autotmp_KcZBYossh-master/socket -o StrictHostKeyChecking=no -o
    UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o
    ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4
    -o Protocol=2 -l root -p 22' -az --no-o --no-g
    root@chromeos6-row2-rack6-host22:"/usr/local/autotest/results/default/"
    "/usr/local/autotest/results/113515254-chromeos-
    test/chromeos6-row2-rack6-host22"
Exit status: 23
Duration: 0.452420949936

stderr:
rsync: change_dir "/usr/local/autotest/results/default" failed: No such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1655) [Receiver=3.1.0]
rsync: [Receiver] write error: Broken pipe (32) (23)
04/20 12:09:48.597 DEBUG|      abstract_ssh:0390| Trying scp.
04/20 12:09:48.598 DEBUG|          ssh_host:0284| Running (ssh) 'ls "/usr/local/autotest/results/default/"*'
04/20 12:09:49.167 DEBUG|        base_utils:0280| [stderr] ls: cannot access /usr/local/autotest/results/default/*: No such file or directory
04/20 12:09:49.171 DEBUG|          ssh_host:0284| Running (ssh) 'ls "/usr/local/autotest/results/default/".[!.]*'
04/20 12:09:49.681 DEBUG|        base_utils:0280| [stderr] ls: cannot access /usr/local/autotest/results/default/.[!.]*: No such file or directory
04/20 12:09:49.688 DEBUG|        server_job:1371| Client state file /usr/local/autotest/results/113515254-chromeos-test/chromeos6-row2-rack6-host22/control.autoserv.state not found
04/20 12:09:49.691 DEBUG|          base_job:0392| Persistent state client.* deleted
04/20 12:09:49.693 DEBUG|          autotest:0960| Autotest job finishes.
04/20 12:09:49.693 ERROR|        server_job:0809| Exception escaped control file, job aborting:
Traceback (most recent call last):
  File "/usr/local/autotest/server/server_job.py", line 801, in run
    self._execute_code(server_control_file, namespace)
  File "/usr/local/autotest/server/server_job.py", line 1301, in _execute_code
    execfile(code_file, namespace, namespace)
  File "/usr/local/autotest/results/113515254-chromeos-test/chromeos6-row2-rack6-host22/control.srv", line 10, in <module>
    job.parallel_simple(run_client, machines)
  File "/usr/local/autotest/server/server_job.py", line 625, in parallel_simple
    return_results=return_results)
  File "/usr/local/autotest/server/subcommand.py", line 93, in parallel_simple
    function(arg)
  File "/usr/local/autotest/results/113515254-chromeos-test/chromeos6-row2-rack6-host22/control.srv", line 7, in run_client
    at.run(control, host=host, use_packaging=use_packaging)
  File "/usr/local/autotest/server/autotest.py", line 381, in run
    client_disconnect_timeout, use_packaging=use_packaging)
  File "/usr/local/autotest/server/autotest.py", line 464, in _do_run
    client_disconnect_timeout=client_disconnect_timeout)
  File "/usr/local/autotest/server/autotest.py", line 896, in execute_control
    boot_id = self.host.get_boot_id()
  File "/usr/local/autotest/client/common_lib/hosts/base_classes.py", line 238, in get_boot_id
    boot_id = self.run(cmd, timeout=timeout).stdout.strip()
  File "/usr/local/autotest/server/hosts/ssh_host.py", line 300, in run
    raise error.AutoservRunError(timeout_message, cmderr.args[1])
AutoservRunError: Timeout encountered: /usr/bin/ssh -a -x    -o ControlPath=/tmp/_autotmp_D_oJa9ssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22 chromeos6-row2-rack6-host22 "export LIBC_FATAL_STDERR_=1; if type \"logger\" > /dev/null 2>&1; then logger -tag \"autotest\" \"server[stack::_do_run|execute_control|get_boot_id] -> ssh_run(if [ -f '/proc/sys/kernel/random/boot_id' ]; then cat '/proc/sys/kernel/random/boot_id'; else echo 'no boot_id available'; fi)\";fi; if [ -f '/proc/sys/kernel/random/boot_id' ]; then cat '/proc/sys/kernel/random/boot_id'; else echo 'no boot_id available'; fi"
* Command: 
    /usr/bin/ssh -a -x    -o ControlPath=/tmp/_autotmp_D_oJa9ssh-
    master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null
    -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o
    ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22
    chromeos6-row2-rack6-host22 "export LIBC_FATAL_STDERR_=1; if type
    \"logger\" > /dev/null 2>&1; then logger -tag \"autotest\"
    \"server[stack::_do_run|execute_control|get_boot_id] -> ssh_run(if [ -f
    '/proc/sys/kernel/random/boot_id' ]; then cat
    '/proc/sys/kernel/random/boot_id'; else echo 'no boot_id available';
    fi)\";fi; if [ -f '/proc/sys/kernel/random/boot_id' ]; then cat
    '/proc/sys/kernel/random/boot_id'; else echo 'no boot_id available'; fi"
Exit status: 255
Duration: 61.2689490318

 

Comment 1 by nxia@chromium.org, Apr 20 2017

Cc: jrbarnette@chromium.org tbroch@chromium.org zhihongyu@chromium.org owenlin@chromium.org shuqianz@chromium.org
this is believed to be caused network connectivity issues we're having now.

Comment 2 by nxia@chromium.org, Apr 22 2017

Mergedinto: 714259
Status: Duplicate (was: Untriaged)

Sign in to add a comment