New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 615659 link

Starred by 1 user

Issue metadata

Status: Available
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug

Blocking:
issue 761492



Sign in to add a comment

provision fails because during verify, cros.verify fails because system-services isn't running

Project Member Reported by kevcheng@chromium.org, May 28 2016

Issue description

https://uberchromegw.corp.google.com/i/chromeos/builders/whirlwind-paladin/builds/4749

DUT successfully provisioned but during verify it failed because the system-services weren't running.  This is probably a one-off but reporting for posterity.

The failure was described as: 
"provision: FAIL: command execution error, completed successfully"

  * Command: 
      /usr/bin/ssh -a -x    -o ControlPath=/tmp/_autotmp_3hAiUqssh-
      master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null
      -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=900 -o
      ServerAliveCountMax=3 -o ConnectionAttempts=4 -o Protocol=2 -l root -p 22
      chromeos4-row10-rack12-host2 "export LIBC_FATAL_STDERR_=1; if type
      \"logger\" > /dev/null 2>&1; then logger -tag \"autotest\"
      \"server[stack::verify|verify_software|upstart_status] -> ssh_run(status
      system-services | grep start/running)\";fi; status system-services | grep
      start/running"
 
Summary: provision fails because during verify, cros.verify fails because system-services isn't running (was: cros.verify fails because system-services isn't running)
Cc: jrbarnette@chromium.org
What is system-services?
Cc: ranix@chromium.org
Labels: -Pri-3 Pri-1
"system-services" is the name of a standard CrOS upstart
job.  On Chrome OS, it starts after Chrome reaches login prompt.
I don't know what triggers it on whirlwind, but if it fails
to start, it's most likely a serious bug in the product code.

Cc: xixuan@chromium.org
Components: Infra>Client>ChromeOS
Looks like the same symptoms as https://luci-milo.appspot.com/buildbot/chromeos/peppy-paladin/16536

I also note that as pointed out in Issue 761492 , this error message is very misleading.
Blocking: 761492
OK, the underlying flaw that causes the error is likely to be
bug 765686, which I've classified as a product bug.  We can/should
also fix the way the problem is reported to make it easier to
diagnose.

Components: -Infra>Client>ChromeOS Infra>Client>ChromeOS>Test
Labels: -Pri-1 Pri-3
Status: Available (was: Untriaged)
The product issue has a separate bug and is probably fixed.  Keeping this to track the poor reporting.

Sign in to add a comment