New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 670478 link

Starred by 1 user

Issue metadata

Status: Archived
Owner:
Last visit > 30 days ago
Closed: Dec 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

M56 Cyan not running out of band suites due to failing tests on builders

Project Member Reported by rohi...@chromium.org, Dec 1 2016

Issue description

https://uberchromegw.corp.google.com/i/chromeos_release/builders/cyan-release%20release-R56-9000.B/builds/5

Cyan hasn't been running out of band test suites since M56 branch cut.
 

Comment 1 by dshi@chromium.org, Dec 1 2016

All builds failed in vmtest, from the log, it seems vmtest didn't even run:
https://pantheon.corp.google.com/storage/browser/chromeos-image-archive/cyan-release/R56-9000.12.0/

more like the vm failed to start.

running a new build with clobber
https://uberchromegw.corp.google.com/i/chromeos_release/builders/cyan-release%20release-R56-9000.B/builds/11

Comment 2 by dchan@google.com, Dec 1 2016

is this the same problem as https://bugs.chromium.org/p/chromium/issues/detail?id=668418

Comment 3 Deleted

Comment 4 by dshi@chromium.org, Dec 1 2016

maybe, the return code (3840) is indeed the same:

chromite.lib.cros_build_lib.TerminateRunCommandError: return code: 3840; command: /b/cbuild/shared_internal/src/platform/crostestutils/au_test_harness/cros_au_test_harness.py '--base_image=/b/cbuild/shared_internal/src/build/images/cyan/latest-cbuildbot/chromiumos_test_image.bin' '--target_image=/b/cbuild/shared_internal/src/build/images/cyan/latest-cbuildbot/chromiumos_test_image.bin' '--board=cyan' '--type=vm' '--remote=0.0.0.0' --verbose '--jobs=1' '--ssh_private_key=/b/cbuild/shared_internal/src/build/images/cyan/latest-cbuildbot/id_rsa' '--verify_suite_name=smoke' '--test_prefix=SimpleTestVerify' '--test_results_root=/b/cbuild/shared_internal/chroot/tmp/cbuildbotI0Ml58/test_harness' --no_graphics --whitelist_chrome_crashes
Received signal 15

Comment 5 by dshi@chromium.org, Dec 1 2016

Cc: bhthompson@chromium.org
+bhthompson
Owner: bhthompson@chromium.org
Status: Started (was: Assigned)
I think this might be the same issue, I guess the config update to make cyan a 'leader' propogated to the branch too, so the branch is now trying to run VMTtests but it is still allocated to a GCE builder. 

I can do a pin and restart and that will probably fix it.
Cc: dgarr...@chromium.org
The below two CLs should do it, after it finishes restarting the builders that need bare metal should have it.

https://chrome-internal-review.googlesource.com/#/c/308282/
https://chrome-internal-review.googlesource.com/#/c/308242/
Status: Fixed (was: Started)
The builders are now bare metal, so I am assuming this is fixed, we just need to let a build finish to verify.

Comment 9 by dchan@google.com, Mar 4 2017

Labels: VerifyIn-58

Comment 10 by dchan@google.com, Apr 17 2017

Labels: VerifyIn-59

Comment 11 by dchan@google.com, May 30 2017

Labels: VerifyIn-60
Labels: VerifyIn-61

Comment 13 by dchan@chromium.org, Oct 14 2017

Status: Archived (was: Fixed)

Sign in to add a comment