New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 696674 link

Starred by 1 user
Status: Verified
Owner:
xixuan@chromium.org
Closed: Sep 2017
Cc:
█ pho...@chromium.org
dgarr...@chromium.org
ayatane@chromium.org
█ jrbarnette@chromium.org
█ nxia@chromium.org
█ chingcodes@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

"rsync status 23" failing tests (daisy/lumpy/stumpy/etc)

Project Member Reported by akes...@chromium.org, Feb 27 2017 
Build:
https://luci-milo.appspot.com/buildbot/chromeos/daisy_skate-paladin/9095

Test:
http://cautotest.corp.google.com/afe/#tab_id=view_job&object_id=103257222

Logs:
https://pantheon.corp.google.com/storage/browser/chromeos-autotest-results/103257222-chromeos-test/chromeos4-row9-rack7-host1/debug

snippet

02/24 18:40:28.279 DEBUG|      abstract_ssh:0357| Using Rsync.
02/24 18:40:28.280 DEBUG|        base_utils:0185| Running 'rsync -l  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_slcDb8ssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos4-row9-rack7-host1:"/usr/local/autotest/results/default/" "/usr/local/autotest/results/103257222-chromeos-test/chromeos4-row9-rack7-host1"'
02/24 18:40:28.636 WARNI|      abstract_ssh:0387| trying scp, rsync failed: Command <rsync -l  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_slcDb8ssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos4-row9-rack7-host1:"/usr/local/autotest/results/default/" "/usr/local/autotest/results/103257222-chromeos-test/chromeos4-row9-rack7-host1"> failed, rc=23, Command returned non-zero exit status
* Command: 
    rsync -l  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp
    /_autotmp_slcDb8ssh-master/socket -o StrictHostKeyChecking=no -o
    UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o
    ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4
    -o Protocol=2 -l root -p 22' -az --no-o --no-g
    root@chromeos4-row9-rack7-host1:"/usr/local/autotest/results/default/"
    "/usr/local/autotest/results/103257222-chromeos-
    test/chromeos4-row9-rack7-host1"
Exit status: 23
Duration: 0.298507928848

stderr:
rsync: change_dir "/usr/local/autotest/results/default" failed: No such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1655) [Receiver=3.1.0]
rsync: [Receiver] write error: Broken pipe (32) (23)
02/24 18:40:28.638 DEBUG|      abstract_ssh:0390| Trying scp.
02/24 18:40:28.638 DEBUG|          ssh_host:0284| Running (ssh) 'ls "/usr/local/autotest/results/default/"*'
02/24 18:40:28.836 DEBUG|        base_utils:0280| [stderr] ls: cannot access /usr/local/autotest/results/default/*: No such file or directory
02/24 18:40:28.838 DEBUG|          ssh_host:0284| Running (ssh) 'ls "/usr/local/autotest/results/default/".[!.]*'
02/24 18:40:29.020 DEBUG|        base_utils:0280| [stderr] ls: cannot access /usr/local/autotest/results/default/.[!.]*: No such file or directory
02/24 18:40:29.023 DEBUG|        server_job:1371| Client state file /usr/local/autotest/results/103257222-chromeos-test/chromeos4-row9-rack7-host1/control.autoserv.state not found
02/24 18:40:29.025 DEBUG|          base_job:0392| Persistent state client.* deleted
02/24 18:40:29.027 ERROR|        server_job:0809| Exception escaped control file, job aborting:
Traceback (most recent call last):
  File "/usr/local/autotest/server/server_job.py", line 801, in run
    self._execute_code(server_control_file, namespace)
  File "/usr/local/autotest/server/server_job.py", line 1301, in _execute_code
    execfile(code_file, namespace, namespace)
  File "/usr/local/autotest/results/103257222-chromeos-test/chromeos4-row9-rack7-host1/control.srv", line 10, in <module>
    job.parallel_simple(run_client, machines)
  File "/usr/local/autotest/server/server_job.py", line 625, in parallel_simple
    return_results=return_results)
  File "/usr/local/autotest/server/subcommand.py", line 93, in parallel_simple
    function(arg)
  File "/usr/local/autotest/results/103257222-chromeos-test/chromeos4-row9-rack7-host1/control.srv", line 7, in run_client
    at.run(control, host=host, use_packaging=use_packaging)
  File "/usr/local/autotest/server/autotest.py", line 379, in run
    client_disconnect_timeout, use_packaging=use_packaging)
  File "/usr/local/autotest/server/autotest.py", line 462, in _do_run
    client_disconnect_timeout=client_disconnect_timeout)
  File "/usr/local/autotest/server/autotest.py", line 896, in execute_control
    logger, client_disconnect_timeout)
  File "/usr/local/autotest/server/autotest.py", line 841, in execute_section
    raise err
AutotestRunError: execute_section 0 failed to return anything
stdout:

Comment 1 by chingcodes@chromium.org, Feb 27 2017 

Using same devserver in this bug also related to rsync

https://bugs.chromium.org/p/chromium/issues/detail?id=696690

Comment 2 by aut...@google.com, Mar 1 2017

Owner: xixuan@chromium.org
dupe + Deputy to find

Comment 3 by autumn@chromium.org, Mar 7 2017

Labels: -current-issue

Comment 4 by grundler@chromium.org, Jun 14 2017

Cc: jrbarnette@chromium.org dgarr...@chromium.org
Summary: "rsync status 23" failing tests (daisy/lumpy/stumpy/etc) (was: daisy_skate rsync/scp failure during test)
This is surfacing again:
-------------- lumpy ------------------
https://uberchromegw.corp.google.com/i/chromeos/builders/lumpy-release/builds/5061

autoser.DEBUG log from:
https://pantheon.corp.google.com/storage/browser/chromeos-autotest-results/123107878-chromeos-test/chromeos6-row2-rack7-host13/debug/

06/13 06:20:22.730 DEBUG|             utils:0203| Running 'rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_F6EKkkssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos6-row2-rack7-host13:"/tmp/autoserv-jXie0J/sysinfo" "/usr/local/autotest/results/123107878-chromeos-test/chromeos6-row2-rack7-host13/autoupdate_EndToEndTest.paygen_au_canary_delta"'
06/13 06:20:23.697 WARNI|      abstract_ssh:0380| rsync status 23, retrying
...
06/13 06:20:23.699 DEBUG|             utils:0203| Running 'rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_F6EKkkssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos6-row2-rack7-host13:"/tmp/autoserv-jXie0J/sysinfo" "/usr/local/autotest/results/123107878-chromeos-test/chromeos6-row2-rack7-host13/autoupdate_EndToEndTest.paygen_au_canary_delta"'
06/13 06:20:24.333 WARNI|      abstract_ssh:0387| trying scp, rsync failed: Command <rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_F6EKkkssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos6-row2-rack7-host13:"/tmp/autoserv-jXie0J/sysinfo" "/usr/local/autotest/results/123107878-chromeos-test/chromeos6-row2-rack7-host13/autoupdate_EndToEndTest.paygen_au_canary_delta"> failed, rc=23, Command returned non-zero exit status

--------------- parrot ---------------
https://uberchromegw.corp.google.com/i/chromeos/builders/parrot-release/builds/3851
https://uberchromegw.corp.google.com/i/chromeos/builders/parrot-release/builds/3851/steps/PaygenTestCanary/logs/stdio

Failure message:
  autoupdate_EndToEndTest.paygen_au_canary_delta     FAIL: Failed to receive a download finished notification (download_finished) within 1200 seconds. This could be a problem with the updater or a connectivity issue. For more details, check the update_engine log (in sysinfo or on the DUT, also included in the test log).

The update succeeeded:
06/13 05:39:27.954 INFO |autoupdate_EndToEn:0274| Expecting event_result=1:success version=9628.0.0 event_type=14:download_finished previous_version=any, within 1200 seconds
06/13 05:41:55.503 INFO |autoupdate_EndToEn:0374| Consumed new event: {u'event_result': '1', u'event_type': '14', u'track': 'stable-channel', u'timestamp': '2017-06-13 05:41:55', u'version': '9628.0.0', u'board': 'parrot'}
06/13 05:41:55.503 INFO |autoupdate_EndToEn:0301| Event received after 147.4 seconds

The actual failure is "rsync status 23" as part of storing test artifacts:
   http://cautotest/tko/retrieve_logs.cgi?job=/results/123097113-chromeos-test/



06/13 05:45:47.084 DEBUG|             utils:0203| Running 'rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_tHhazVssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos6-row2-rack3-host2:"/tmp/autoserv-n3F58i/sysinfo" "/usr/local/autotest/results/123097113-chromeos-test/chromeos6-row2-rack3-host2/autoupdate_EndToEndTest.paygen_au_canary_delta"'
06/13 05:45:48.015 WARNI|      abstract_ssh:0380| rsync status 23, retrying
06/13 05:45:48.016 DEBUG|      abstract_ssh:0346| get_file. source: ['/tmp/autoserv-n3F58i/sysinfo'], dest: /usr/local/autotest/results/123097113-chromeos-test/chromeos6-row2-rack3-host2/autoupdate_EndToEndTest.paygen_au_canary_delta, delete_dest: False,preserve_perm: True, preserve_symlinks:False
06/13 05:45:48.016 DEBUG|      abstract_ssh:0357| Using Rsync.
06/13 05:45:48.016 DEBUG|             utils:0203| Running 'rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_tHhazVssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos6-row2-rack3-host2:"/tmp/autoserv-n3F58i/sysinfo" "/usr/local/autotest/results/123097113-chromeos-test/chromeos6-row2-rack3-host2/autoupdate_EndToEndTest.paygen_au_canary_delta"'
06/13 05:45:48.636 WARNI|      abstract_ssh:0387| trying scp, rsync failed: Command <rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_tHhazVssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos6-row2-rack3-host2:"/tmp/autoserv-n3F58i/sysinfo" "/usr/local/autotest/results/123097113-chromeos-test/chromeos6-row2-rack3-host2/autoupdate_EndToEndTest.paygen_au_canary_delta"> failed, rc=23, Command returned non-zero exit status

Comment 5 by grundler@chromium.org, Jun 14 2017

Labels: -Pri-2 Pri-1
----------- quawks -----------
https://uberchromegw.corp.google.com/i/chromeos/builders/quawks-release/builds/1495

Symptom reported:
  autoupdate_EndToEndTest.paygen_au_canary_full      ABORT: Autotest client terminated unexpectedly: DUT is pingable, SSHable and did NOT restart un-expectedly. We probably lost connectivity during the test., Host did not return from reboot

https://pantheon.corp.google.com/storage/browser/chromeos-autotest-results/123040129-chromeos-test/chromeos4-row10-rack9-host1/debug/
autoser.DEBUG

But the test was successful:
06/12 23:06:30.186 INFO |       autoupdater:0253| Triggering update via: /usr/bin/update_engine_client --check_for_update --omaha_url=http://100.115.219.136:33071/update

...
06/12 23:06:50.942 INFO |autoupdate_EndToEn:0274| Expecting event_result=1:success version=9646.0.0 event_type=14:download_finished previous_version=any, within 1200 seconds
06/12 23:14:18.868 INFO |autoupdate_EndToEn:0374| Consumed new event: {u'event_result': '1', u'event_type': '14', u'track': 'stable-channel', u'timestamp': '2017-06-12 23:14:17', u'version': '9646.0.0', u'board': 'quawks'}
06/12 23:14:18.868 INFO |autoupdate_EndToEn:0301| Event received after 447.8 seconds

and failed with:
06/12 23:19:40.268 DEBUG|             utils:0203| Running 'rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_0_i5Skssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos4-row10-rack9-host1:"/tmp/autoserv-Ynu2SH/sysinfo" "/usr/local/autotest/results/123040129-chromeos-test/chromeos4-row10-rack9-host1/autoupdate_EndToEndTest.paygen_au_canary_full"'
06/12 23:19:41.735 WARNI|      abstract_ssh:0380| rsync status 23, retrying
06/12 23:19:41.736 DEBUG|      abstract_ssh:0346| get_file. source: ['/tmp/autoserv-Ynu2SH/sysinfo'], dest: /usr/local/autotest/results/123040129-chromeos-test/chromeos4-row10-rack9-host1/autoupdate_EndToEndTest.paygen_au_canary_full, delete_dest: False,preserve_perm: True, preserve_symlinks:False
06/12 23:19:41.736 DEBUG|      abstract_ssh:0357| Using Rsync.
06/12 23:19:41.737 DEBUG|             utils:0203| Running 'rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_0_i5Skssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos4-row10-rack9-host1:"/tmp/autoserv-Ynu2SH/sysinfo" "/usr/local/autotest/results/123040129-chromeos-test/chromeos4-row10-rack9-host1/autoupdate_EndToEndTest.paygen_au_canary_full"'
06/12 23:19:42.799 WARNI|      abstract_ssh:0387| trying scp, rsync failed: Command <rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_0_i5Skssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos4-row10-rack9-host1:"/tmp/autoserv-Ynu2SH/sysinfo" "/usr/local/autotest/results/123040129-chromeos-test/chromeos4-row10-rack9-host1/autoupdate_EndToEndTest.paygen_au_canary_full"> failed, rc=23, Command returned non-zero exit status

Comment 6 by grundler@chromium.org, Jun 16 2017 

And samus:

https://uberchromegw.corp.google.com/i/chromeos/builders/samus-release/builds/4391/steps/PaygenTestCanary/logs/stdio
https://pantheon.corp.google.com/storage/browser/chromeos-autotest-results/123707426-chromeos-test/chromeos4-row12-rack5-host21/debug/

06/16 07:20:20.333 DEBUG|     site_autotest:0194| AUTOTEST_STATUS::	GOOD	----	sysinfo.after	timestamp=1497622819	localtime=Jun 16 07:20:19	
06/16 07:20:20.334 INFO |        server_job:0199| 		GOOD	----	sysinfo.after	timestamp=1497622819	localtime=Jun 16 07:20:19	
06/16 07:20:20.339 DEBUG|     site_autotest:0194| AUTOTEST_STATUS::END GOOD	----	----	timestamp=1497622819	localtime=Jun 16 07:20:19	
06/16 07:20:20.339 INFO |        server_job:0199| 	END GOOD	----	----	timestamp=1497622819	localtime=Jun 16 07:20:19	
06/16 07:20:20.375 DEBUG|     site_autotest:0194| Got lock of exit_code_file.
06/16 07:20:20.376 INFO |          autotest:1177| Got lock of exit_code_file.
06/16 07:20:20.376 DEBUG|     site_autotest:0194| Released lock of exit_code_file and closed it.
06/16 07:20:20.376 INFO |          autotest:1177| Released lock of exit_code_file and closed it.
06/16 07:20:22.378 DEBUG|     site_autotest:0194| Killing child processes.
06/16 07:20:22.378 INFO |          autotest:1177| Killing child processes.
06/16 07:20:22.390 DEBUG|          autotest:0815| Result exit status is 0.
06/16 07:20:22.390 INFO |          autotest:0913| Client complete
06/16 07:20:22.390 DEBUG|          autotest:0962| Autotest job finishes running. Below is the post-processing operations.
06/16 07:20:22.391 DEBUG|          ssh_host:0286| Running (ssh) 'true'
06/16 07:20:22.778 DEBUG|      abstract_ssh:0587| Host chromeos4-row12-rack5-host21 is now up
06/16 07:20:22.780 DEBUG|          autotest:1015| Getting directory summary for /tmp/sysinfo/autoserv-Alrbss/results/default.
06/16 07:20:22.781 DEBUG|          ssh_host:0286| Running (ssh) '/tmp/sysinfo/autoserv-Alrbss/bin/result_utils.py -p /tmp/sysinfo/autoserv-Alrbss/results/default/'
06/16 07:20:23.207 DEBUG|      abstract_ssh:0346| get_file. source: /tmp/sysinfo/autoserv-Alrbss/results/default/, dest: /usr/local/autotest/results/123707426-chromeos-test/chromeos4-row12-rack5-host21, delete_dest: False,preserve_perm: True, preserve_symlinks:True
06/16 07:20:23.208 DEBUG|      abstract_ssh:0357| Using Rsync.
06/16 07:20:23.208 DEBUG|             utils:0203| Running 'rsync -l  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_5tor2Yssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos4-row12-rack5-host21:"/tmp/sysinfo/autoserv-Alrbss/results/default/" "/usr/local/autotest/results/123707426-chromeos-test/chromeos4-row12-rack5-host21"'
06/16 07:20:23.678 DEBUG|          base_job:0253| Importing client.steps from state file /usr/local/autotest/results/123707426-chromeos-test/chromeos4-row12-rack5-host21/control.autoserv.state
06/16 07:20:23.678 DEBUG|          base_job:0253| Importing client.harness from state file /usr/local/autotest/results/123707426-chromeos-test/chromeos4-row12-rack5-host21/control.autoserv.state
06/16 07:20:23.679 DEBUG|          base_job:0250| Value of client.sysinfo is unchanged, skipping import
06/16 07:20:23.679 DEBUG|          base_job:0253| Importing client._record_indent from state file /usr/local/autotest/results/123707426-chromeos-test/chromeos4-row12-rack5-host21/control.autoserv.state
06/16 07:20:23.679 DEBUG|          base_job:0250| Value of public.client_success is unchanged, skipping import
06/16 07:20:23.679 DEBUG|          base_job:0250| Value of global_properties.tag is unchanged, skipping import
06/16 07:20:23.679 DEBUG|          base_job:0250| Value of global_properties.test_retry is unchanged, skipping import
06/16 07:20:23.682 DEBUG|          base_job:0399| Persistent state client.* deleted
06/16 07:20:23.683 DEBUG|          autotest:0976| Autotest job finishes.
06/16 07:20:23.684 DEBUG|      abstract_ssh:0346| get_file. source: /tmp/autoserv-lM4jbV/sysinfo, dest: /usr/local/autotest/results/123707426-chromeos-test/chromeos4-row12-rack5-host21/autoupdate_EndToEndTest.paygen_au_canary_full, delete_dest: False,preserve_perm: True, preserve_symlinks:False
06/16 07:20:23.684 DEBUG|      abstract_ssh:0357| Using Rsync.
06/16 07:20:23.685 DEBUG|             utils:0203| Running 'rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_5tor2Yssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos4-row12-rack5-host21:"/tmp/autoserv-lM4jbV/sysinfo" "/usr/local/autotest/results/123707426-chromeos-test/chromeos4-row12-rack5-host21/autoupdate_EndToEndTest.paygen_au_canary_full"'
06/16 07:20:24.504 WARNI|      abstract_ssh:0380| rsync status 23, retrying
06/16 07:20:24.504 DEBUG|      abstract_ssh:0346| get_file. source: ['/tmp/autoserv-lM4jbV/sysinfo'], dest: /usr/local/autotest/results/123707426-chromeos-test/chromeos4-row12-rack5-host21/autoupdate_EndToEndTest.paygen_au_canary_full, delete_dest: False,preserve_perm: True, preserve_symlinks:False
06/16 07:20:24.505 DEBUG|      abstract_ssh:0357| Using Rsync.
06/16 07:20:24.505 DEBUG|             utils:0203| Running 'rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_5tor2Yssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos4-row12-rack5-host21:"/tmp/autoserv-lM4jbV/sysinfo" "/usr/local/autotest/results/123707426-chromeos-test/chromeos4-row12-rack5-host21/autoupdate_EndToEndTest.paygen_au_canary_full"'
06/16 07:20:25.003 WARNI|      abstract_ssh:0387| trying scp, rsync failed: Command <rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_5tor2Yssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos4-row12-rack5-host21:"/tmp/autoserv-lM4jbV/sysinfo" "/usr/local/autotest/results/123707426-chromeos-test/chromeos4-row12-rack5-host21/autoupdate_EndToEndTest.paygen_au_canary_full"> failed, rc=23, Command returned non-zero exit status
* Command: 
    rsync -L  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp
    /_autotmp_5tor2Yssh-master/socket -o StrictHostKeyChecking=no -o
    UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o
    ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4
    -o Protocol=2 -l root -p 22' -az --no-o --no-g
    root@chromeos4-row12-rack5-host21:"/tmp/autoserv-lM4jbV/sysinfo"
    "/usr/local/autotest/results/123707426-chromeos-test/chromeos4-row12-rack5
    -host21/autoupdate_EndToEndTest.paygen_au_canary_full"
Exit status: 23
Duration: 0.450413942337

Comment 7 by akes...@chromium.org, Jul 17 2017

Labels: akeshet-pending-downgrade
ChromeOS Infra P1 Bugscrub.

P1 Bugs in this component should be important enough to get weekly status updates.

Is this already fixed?  -> Fixed
Is this no longer relevant? -> Archived or WontFix
Is this not a P1, based on go/chromeos-infra-bug-slo rubric? -> lower priority.
Is this a Feature Request rather than a bug? Type -> Feature
Is this missing important information or scope needed to decide how to proceed? -> Ask question on bug, possibly reassign.
Does this bug have the wrong owner? -> reassign.

Bugs that remain in this state next week will be downgraded to P2.

Comment 8 by akes...@chromium.org, Jul 24 2017

Labels: -akeshet-pending-downgrade Pri-2
ChromeOS Infra P1 Bugscrub.

Issue untouched in a week after previous message. Downgrading to P2.

Comment 9 by dhadd...@chromium.org, Sep 19 2017

Labels: FixedByAURewrite
Status: Verified (was: Untriaged)
Obsolete with au test rewrite
►

Sign in to add a comment