New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 755249 link

Starred by 2 users

Issue metadata

Status: Archived
Owner:
Last visit > 30 days ago
Closed: Aug 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

provision: FAIL: Unhandled DevServerException: CrOS auto-update failed

Project Member Reported by warx@chromium.org, Aug 14 2017

Issue description

Failed build: https://uberchromegw.corp.google.com/i/chromeos.chrome/builders/peach_pit-tot-chrome-pfq-informational/builds/7363

I saw crashcollect:0119| Non-critical failure: collection of /var/tmp/messages.autotest_start failed: invalid literal for int() with base 10: '' in the test log.

Passed to infra people for investigation.
 

Comment 1 by warx@chromium.org, Aug 14 2017

Status: Assigned (was: Untriaged)

Comment 2 by warx@chromium.org, Aug 14 2017

Doesn't fail constantly, #7364 is fine. P1 -> P2.

Comment 3 by warx@chromium.org, Aug 18 2017

happens again on #7408
https://uberchromegw.corp.google.com/i/chromeos.chrome/builders/peach_pit-tot-chrome-pfq-informational/builds/7408

provision_AutoUpdate.double               FAIL: Unhandled DevServerException: CrOS auto-update failed for host chromeos6-row2-rack11-host18: SSHConnectionError: ssh: connect to host chromeos6-row2-rack11-host18 port 22: Connection timed out

Comment 4 by nxia@chromium.org, Aug 18 2017

Error log for #3:

08/17 17:19:47.932 DEBUG|             utils:0212| Running 'ssh 100.115.185.227 'curl "http://100.115.185.227:8082/kill_au_proc?pid=39142&host_name=chromeos6-row2-rack11-host18"''
08/17 17:19:49.462 DEBUG|        dev_server:2153| Exception raised on auto_update attempt #1:
 Traceback (most recent call last):
  File "/home/chromeos-test/chromiumos/src/platform/dev/cros_update.py", line 264, in TriggerAU
    self._WriteAUStatus(cros_update_progress.FINISHED)
  File "/home/chromeos-test/chromiumos/chromite/lib/remote_access.py", line 566, in __exit__
    self.device.Cleanup()
  File "/home/chromeos-test/chromiumos/chromite/lib/remote_access.py", line 695, in Cleanup
    self.BaseRunCommand(cmd, **kwargs)
  File "/home/chromeos-test/chromiumos/chromite/lib/remote_access.py", line 889, in BaseRunCommand
    return self.GetAgent().RemoteSh(cmd, **kwargs)
  File "/home/chromeos-test/chromiumos/chromite/lib/remote_access.py", line 344, in RemoteSh
    raise SSHConnectionError(e.result.error)
SSHConnectionError: ssh: connect to host chromeos6-row2-rack11-host18 port 22: Connection timed out

Comment 5 by nxia@chromium.org, Aug 18 2017

Error log for #1:

08/14 10:54:28.246 DEBUG|             utils:0212| Running 'ssh 100.115.185.226 'curl "http://100.115.185.226:8082/kill_au_proc?pid=24280&host_name=chromeos6-row2-rack11-host3"''
08/14 10:54:29.881 DEBUG|        dev_server:2153| Exception raised on auto_update attempt #1:
 Traceback (most recent call last):
  File "/home/chromeos-test/chromiumos/src/platform/dev/cros_update.py", line 259, in TriggerAU
    self._RootfsUpdate(chromeos_AU)
  File "/home/chromeos-test/chromiumos/src/platform/dev/cros_update.py", line 170, in _RootfsUpdate
    cros_updater.UpdateRootfs()
  File "/home/chromeos-test/chromiumos/chromite/lib/auto_updater.py", line 717, in UpdateRootfs
    raise RootfsUpdateError(error_msg % e)
RootfsUpdateError: Failed to perform rootfs update: RootfsUpdateError('Update failed with unexpected update status: UPDATE_STATUS_IDLE',)

Comment 6 by nxia@chromium.org, Aug 18 2017

The duts and devservers are different. More like a network flakiness to me. 

Comment 7 by nxia@chromium.org, Aug 28 2017

Status: Archived (was: Assigned)
peach_pit-tot-chrome-pfq-informational has been healthy

Sign in to add a comment