https://pantheon.corp.google.com/storage/browser/chromeos-autotest-results/113286568-chromeos-test/chromeos6-row2-rack10-host7/debug/


I am not sure what is the real issue here. It looks like the test had been finished. But it failed while collecting data. 

First, there are two timeouts(30 seconds) in ssh commands. 
run process timeout (30) fired on: /usr/bin/ssh -a -x    -o ControlPath=/tmp/_autotmp_4o6_CPssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22 chromeos6-row2-rack10-host7 "export LIBC_FATAL_STDERR_=1; if type \"logger\" > /dev/null 2>&1; then logger -tag \"autotest\"


Then an ssh failed with exit status 255.

But in the end, the system seems OK while in diagnosis. 
04/18 19:44:04.367 DEBUG|          ssh_host:0284| Running (ssh) 'echo A > /usr/local/autotest/tmp/_autotmp_yibH5dharness-fifo/autoserv.fifo'
04/18 19:44:04.708 DEBUG|          autotest:0805| Result exit status is 255.



======
04/18 19:42:41.490 WARNI|        base_utils:0912| run process timeout (30) fired on: /usr/bin/ssh -a -x    -o ControlPath=/tmp/_autotmp_4o6_CPssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22 chromeos6-row2-rack10-host7 "export LIBC_FATAL_STDERR_=1; if type \"logger\" > /dev/null 2>&1; then logger -tag \"autotest\" \"server[stack::wait_up|is_up|ssh_ping] -> ssh_run(true)\";fi; true"
04/18 19:42:42.498 DEBUG|          ssh_host:0212| retrying ssh command after timeout
04/18 19:43:12.745 WARNI|        base_utils:0912| run process timeout (30) fired on: /usr/bin/ssh -a -x    -o ControlPath=/tmp/_autotmp_4o6_CPssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22 chromeos6-row2-rack10-host7 "export LIBC_FATAL_STDERR_=1; if type \"logger\" > /dev/null 2>&1; then logger -tag \"autotest\" \"server[stack::wait_up|is_up|ssh_ping] -> ssh_run(true)\";fi; true"
04/18 19:43:13.754 DEBUG|          ssh_host:0218| retry 2: restarting master connection
04/18 19:43:13.754 DEBUG|      abstract_ssh:0744| Restarting master ssh connection
04/18 19:43:13.754 DEBUG|      abstract_ssh:0756| Nuking master_ssh_job.
04/18 19:43:14.760 DEBUG|      abstract_ssh:0762| Cleaning master_ssh_tempdir.
04/18 19:43:14.762 INFO |      abstract_ssh:0809| Starting master ssh connection '/usr/bin/ssh -a -x   -N -o ControlMaster=yes -o ControlPath=/tmp/_autotmp_ne5Adassh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22 chromeos6-row2-rack10-host7'
04/18 19:43:14.763 DEBUG|        base_utils:0185| Running '/usr/bin/ssh -a -x   -N -o ControlMaster=yes -o ControlPath=/tmp/_autotmp_ne5Adassh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22 chromeos6-row2-rack10-host7'
04/18 19:43:26.803 DEBUG|      abstract_ssh:0587| Host chromeos6-row2-rack10-host7 is now up
04/18 19:43:26.805 DEBUG|      abstract_ssh:0346| get_file. source: /usr/local/autotest/results/default/, dest: /usr/local/autotest/results/113286568-chromeos-test/chromeos6-row2-rack10-host7, delete_dest: False,preserve_perm: True, preserve_symlinks:True
04/18 19:43:26.805 DEBUG|      abstract_ssh:0357| Using Rsync.
04/18 19:43:26.806 DEBUG|        base_utils:0185| Running 'rsync -l  --timeout=1800 --rsh='/usr/bin/ssh -a -x   -o ControlPath=/tmp/_autotmp_ne5Adassh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22' -az --no-o --no-g root@chromeos6-row2-rack10-host7:"/usr/local/autotest/results/default/" "/usr/local/autotest/results/113286568-chromeos-test/chromeos6-row2-rack10-host7"'
04/18 19:44:04.367 DEBUG|          ssh_host:0284| Running (ssh) 'echo A > /usr/local/autotest/tmp/_autotmp_yibH5dharness-fifo/autoserv.fifo'
04/18 19:44:04.708 DEBUG|          autotest:0805| Result exit status is 255.
04/18 19:44:04.710 DEBUG|        base_utils:0185| Running 'ping chromeos6-row2-rack10-host7 -w1 -c1'
04/18 19:44:04.900 DEBUG|        base_utils:0280| [stdout] PING chromeos6-row2-rack10-host7.cros.corp.google.com (100.115.129.81) 56(84) bytes of data.
04/18 19:44:04.901 DEBUG|        base_utils:0280| [stdout] 64 bytes from dhcp-100-115-129-81.mtv.corp.google.com (100.115.129.81): icmp_seq=1 ttl=57 time=59.8 ms
04/18 19:44:04.902 DEBUG|        base_utils:0280| [stdout] 
04/18 19:44:04.902 DEBUG|        base_utils:0280| [stdout] --- chromeos6-row2-rack10-host7.cros.corp.google.com ping statistics ---
04/18 19:44:04.902 DEBUG|        base_utils:0280| [stdout] 1 packets transmitted, 1 received, 0% packet loss, time 0ms
04/18 19:44:04.903 DEBUG|        base_utils:0280| [stdout] rtt min/avg/max/mdev = 59.887/59.887/59.887/0.000 ms
04/18 19:44:04.904 DEBUG|          ssh_host:0284| Running (ssh) 'if [ -f '/proc/sys/kernel/random/boot_id' ]; then cat '/proc/sys/kernel/random/boot_id'; else echo 'no boot_id available'; fi'
04/18 19:44:05.210 DEBUG|        base_utils:0280| [stdout] e3ff5e79-efdf-4ea4-89ed-0cab48f570e2
04/18 19:44:05.215 INFO |        server_job:0184| 	ABORT	----	----	timestamp=1492569845	localtime=Apr 18 19:44:05	Autotest client terminated unexpectedly: DUT is pingable, SSHable and did NOT restart un-expectedly. We probably lost connectivity during the test.