New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 599674 link

Starred by 2 users

Issue metadata

Status: Verified
Owner:
Last visit > 30 days ago
Closed: Apr 2016
Cc:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

glados-release-group chell and cave fail buildpackages

Project Member Reported by bhthompson@chromium.org, Mar 31 2016

Issue description

This should probably have closed the tree, however it seems this group never got back importance (I can fix that) :(.

Chell has been failing BuildPackages since 8075.0.0 on March 17th, this is conspicuously in line with the addition of Cave.

The last green Chell build was 7932.0.0 on February 16th.

The current failure seems to be of several packages https://uberchromegw.corp.google.com/i/chromeos/builders/glados-release-group/builds/849

Interestingly the Kunimitsu builder is green, and it should be a very similar build.

Given we have not had a successful build of this system for over a month, I propose this is a Pri-0, can one of the sheriffs dig into this?


 
Cc: yungleem@chromium.org

Comment 2 by moch@chromium.org, Apr 1 2016

The M50 release builder seems to be working fine.

On ToT the builder seems to building various packages from source. The packages seem to be completing eventually but the builder times out. The only package that actually failed is

chromeos-base/chromeos-chrome-51.0.2695.1_rc-r1
Owner: moch@chromium.org
Assigning to moch@ as he seems to be looking at it, thanks!

Comment 4 by moch@chromium.org, Apr 1 2016

Status: Started (was: Untriaged)
Spoke to Aviv (build deputy) - there is a possibility that adding the cave builder added marginally more to that build group causing the builds to timeout and fail. Suggestion is to revert the original CL that added cave to this group and setup cave in a separate build group.

Reverting the cave builder config CL - https://chromium-review.googlesource.com/#/c/336800/
Project Member

Comment 5 by bugdroid1@chromium.org, Apr 1 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/chromite/+/c5d2f99bcd76bb430a585137c37f7b32d3a6c4b3

commit c5d2f99bcd76bb430a585137c37f7b32d3a6c4b3
Author: Mohammed Habibulla <moch@google.com>
Date: Fri Apr 01 17:15:54 2016

Revert "Add Cave builder configuration"

Adding cave builder to glados-release group is causing both Cave/Chell builders to fail. Need to add cave builder to a new group.

BUG= chromium:599674 

This reverts commit 060710e20fd5eb3e81decdc4b76b785c7714e23c.

Change-Id: I4b6dc96001a3b81057fbf2187d409f44d8d5f47e
Reviewed-on: https://chromium-review.googlesource.com/336800
Reviewed-by: Mohammed Habibulla <moch@google.com>
Tested-by: Mohammed Habibulla <moch@google.com>

[modify] https://crrev.com/c5d2f99bcd76bb430a585137c37f7b32d3a6c4b3/cbuildbot/config_dump.json
[modify] https://crrev.com/c5d2f99bcd76bb430a585137c37f7b32d3a6c4b3/cbuildbot/waterfall_layout_dump.txt
[modify] https://crrev.com/c5d2f99bcd76bb430a585137c37f7b32d3a6c4b3/cbuildbot/chromeos_config.py

Comment 6 by moch@chromium.org, Apr 1 2016

Owner: ttsang@chromium.org
reassigning to trevor to add cave builder as a separate group.

Comment 7 by moch@chromium.org, Apr 1 2016

Cc: akes...@chromium.org
Owner: moch@chromium.org
I reverted the revert. The original revert was done via gerrit. Aviv suggested that all chromite CLs need to be verified through the pre-upload hooks and commit-queue. Now that we have some idea of the possible issue I'm lowering to P1 and will submit a CL that goes through the CQ

Comment 8 by moch@chromium.org, Apr 1 2016

Labels: -Pri-0 Pri-1
Cc: dgarr...@chromium.org
Do we know why this only happened to GlaDOS?

We have a few builders in the Kunimitsu group and that build should be essentially the same.

This sounds like a good place to try out more GCE builders once they are available.

Comment 10 by moch@chromium.org, Apr 11 2016

Status: Fixed (was: Started)
Chell buildpackages now passes. The builder is now failing on the paygen step. Filed https://bugs.chromium.org/p/chromium/issues/detail?id=602338. Closing this bug.
Status: Verified (was: Fixed)

Sign in to add a comment