New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 685307 link

Starred by 1 user

Issue metadata

Status: Archived
Owner:
Closed: Jan 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 0
Type: Bug



Sign in to add a comment

M56 pfq not uprevving

Project Member Reported by gkihumba@google.com, Jan 25 2017

Issue description

Link to builder:
https://uberchromegw.corp.google.com/i/chromeos_release/builders/samus-pre-flight-branch%20release-R56-9000.B

Traceback (most recent call last):
  File "/tmp/cbuildbot-tmpEasbgt/tmpPwrVG2/chromite/lib/failures_lib.py", line 172, in wrapped_functor
    return functor(*args, **kwargs)
  File "/tmp/cbuildbot-tmpEasbgt/tmpPwrVG2/chromite/cbuildbot/stages/sync_stages.py", line 867, in PerformStage
    next_manifest = self.GetNextManifest()
  File "/tmp/cbuildbot-tmpEasbgt/tmpPwrVG2/chromite/cbuildbot/stages/sync_stages.py", line 985, in GetNextManifest
    build_id=build_id)
  File "/tmp/cbuildbot-tmpEasbgt/tmpPwrVG2/chromite/cbuildbot/lkgm_manager.py", line 325, in CreateNewCandidate
    self.CheckoutSourceCode()
  File "/tmp/cbuildbot-tmpEasbgt/tmpPwrVG2/chromite/cbuildbot/manifest_version.py", line 1043, in CheckoutSourceCode
    self.cros_source.Sync(self.manifest)
  File "/tmp/cbuildbot-tmpEasbgt/tmpPwrVG2/chromite/cbuildbot/repository.py", line 517, in Sync
    raise SrcCheckOutException(err_msg)
SrcCheckOutException: return code: 2; command: repo --time sync '--cache-dir=/b/cros_git_cache' -n
cwd=/b/cbuild/shared_internal
 
Cc: dgarr...@chromium.org
I think this is an instance of an out-of-date builder going into
service:  The last successful build used builder build304-m2.
The first failure used builder build110-m2.

I think this is the relevant portion of the failure logs:

info: A new version of repo is available


object 69034721e607ecbe8dad736c8ce07d91efdc8353
type commit
tag v1.12.37-cr1
tagger Mike Frysinger <vapier@chromium.org> 1476811349 -0400

Chromium-specific release

gpg: Signature made Tue 18 Oct 2016 10:22:29 AM PDT
gpg:                using RSA key DA03FD3916B500A8
gpg: Can't check signature: public key not found


warning: Skipped upgrade to unverified version

Cc: nxia@chromium.org
Status: Started (was: Assigned)
chromite in R56 depends on a new version of repo, but `repo selfupdate` is failing.

This was recently fixed on master by nxia@. I've created cherry-picks to R56.
https://chromium-review.googlesource.com/#/c/432916/
https://chromium-review.googlesource.com/#/c/432936/
@nxia: I think these two are the only CLs needed. Can you confirm?
Secondly, I think we should CP these to all active release branches. R57, R55?
Labels: Merge-Request-56

Comment 5 by gkihumba@google.com, Jan 25 2017

Labels: Merge-Approved-56
Project Member

Comment 6 by sheriffbot@chromium.org, Jan 25 2017

Labels: -Merge-Request-56 Merge-Review-56 Hotlist-Merge-Review
This bug requires manual review: We are only 5 days from stable.
Please contact the milestone owner if you have questions.
Owners: amineer@(clank), cmasso@(bling), gkihumba@(cros), bustamante@(desktop)

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Labels: -Pri-1 Pri-0
Owner: nxia@chromium.org
Assigning to nxia.
She is taking a look at the bug, and can land the CLs I CP'ed for the purpose.

Comment 8 by nxia@chromium.org, Jan 25 2017

https://chromium-review.googlesource.com/#/c/432916/ should solve the repo version issue here. 
https://chromium-review.googlesource.com/#/c/432936/ should solve repo init issues we saw in other builds. 
It doesn't hurt to merge both CLs.

Comment 9 by nxia@chromium.org, Jan 25 2017

Owner: gkihumba@google.com
I manually removed .repo/repo dir in /b/cbuild/shared_internal, the build should be fine now.

Please force samus-pre-flight-branch release-R56-9000.B if you want.
Re #8: I'm holding off of merging those CLs at this point. If the builder is fixed, I'd rather not merge anything on the day we're trying to branch stable.
Owner: pprabhu@chromium.org
https://uberchromegw.corp.google.com/i/chromeos_release/builders/samus-pre-flight-branch%20release-R56-9000.B/builds/197 clobbered the builder and seems to be doing OK.

Comment 12 by nxia@chromium.org, Jan 25 2017

Re#11 I didn't clobber the builder actually. I only deleted the .repo/repo dir, where stored the checked out repo tool.
Status: Fixed (was: Started)
That build has gotten past the sync stage. I'm going to call this a victory.
Project Member

Comment 14 by sheriffbot@chromium.org, Jan 30 2017

This issue has been approved for a merge. Please merge the fix to any appropriate branches as soon as possible!

If all merges have been completed, please remove any remaining Merge-Approved labels from this issue.

Thanks for your time! To disable nags, add the Disable-Nags label.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Labels: -Hotlist-Merge-Review -Merge-Approved-56 -Merge-Review-56
I'll skip the merge because clobbering the builder is an effective workaround, I don't expect to see this issue often, and I'd rather not merge into stable.

Removing all merge labels so that sheriffbot doesn't keep track of this bug as a merge candidate.

Comment 16 by dchan@google.com, Apr 17 2017

Labels: VerifyIn-59

Comment 17 by dchan@google.com, May 30 2017

Labels: VerifyIn-60
Labels: VerifyIn-61

Comment 19 by dchan@chromium.org, Oct 14 2017

Status: Archived (was: Fixed)

Sign in to add a comment