New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 634944 link

Starred by 8 users

Issue metadata

Status: Fixed
Owner:
Closed: Jan 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Feature



Sign in to add a comment

Avoid wasting human/bots resources and re-use tryjobs if patchsets differ in base or description only

Project Member Reported by tandrii@chromium.org, Aug 5 2016

Issue description

Editing description on Gerrit creates a new patchset. This means all previous tryjobs are discarded. In some way, that's good because description of CL may have directives for CQ processing. On the other hand, for trivial typo fixes, this would be a waste of resources. 

Hence, either:
* document that's the case
* teach CQ to figure it out (difficult)


Note, that in Rietveld description changes don't result in new patchsets.
 
Labels: Proj-Gerrit-Migration
Labels: Pri-2

Comment 4 by rmis...@google.com, Sep 23 2016

Blocking: skia:5612
Cc: tandrii@chromium.org
Labels: Milestone-Dogfood

Comment 6 by tandrii@google.com, Sep 27 2016

Cc: rmis...@chromium.org
Ravi, why is skia blocked on this bug? Are you lacking capacity?
The main resource being wasted here is human patience.  Even if we have the bots to re-run the CQ, it adds latency to the critical path of landing the CL, seeing how the broader bot pool handles it, rolling into Chrome, etc.

Comment 8 by tandrii@google.com, Sep 27 2016

mtklein@ That's true. Thanks for reply!
Summary: Avoid wasting human/bots resources and re-use tryjobs if patchsets differ in base or description only (was: Avoid wasting resources if only description is different between Gerrit patchsets)
Labels: -Milestone-Dogfood Milestone-Fishfood
Friendly ping.  This is extremely painful, and I'm finding myself not changing incomplete or incorrect CL titles/descriptions to save the 30+ minutes wait and bot time.
I haven't forgotten this, but I have higher priority task to kill gnumbd.
The doc is still in RFC state, though I had tentative agreement from Nodir to allow appending tags after job is complete.

If someone is willing to work on this, I'll assist gladly, but I won't drive this till I go/git-numberer is done.
Project Member

Comment 13 by bugdroid1@chromium.org, Nov 29 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/421a572d8a0820a3aa8205e11544204a1159b57f

commit 421a572d8a0820a3aa8205e11544204a1159b57f
Author: Andrii Shyshkalov <tandrii@chromium.org>
Date: Tue Nov 29 18:57:12 2016

Project Member

Comment 14 by bugdroid1@chromium.org, Nov 29 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/a19d7b0aedd21354e7d003640b7c7d16243f599f

commit a19d7b0aedd21354e7d003640b7c7d16243f599f
Author: Andrii Shyshkalov <tandrii@chromium.org>
Date: Tue Nov 29 22:22:53 2016

Project Member

Comment 15 by bugdroid1@chromium.org, Nov 29 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/571e27a93780f02a6a4afe41d4cbf84d6b4802f9

commit 571e27a93780f02a6a4afe41d4cbf84d6b4802f9
Author: Andrii Shyshkalov <tandrii@chromium.org>
Date: Tue Nov 29 22:24:26 2016

Project Member

Comment 16 by bugdroid1@chromium.org, Nov 29 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/c344aabd866b93c5382c6d721b529cced8867427

commit c344aabd866b93c5382c6d721b529cced8867427
Author: Andrii Shyshkalov <tandrii@chromium.org>
Date: Tue Nov 29 22:39:07 2016

Project Member

Comment 17 by bugdroid1@chromium.org, Nov 30 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/bb75b3ad09160727a473e6bb6315567c2c31d259

commit bb75b3ad09160727a473e6bb6315567c2c31d259
Author: Andrii Shyshkalov <tandrii@chromium.org>
Date: Tue Nov 29 23:00:08 2016

Andrii, are you working on this now? Can you please update bug status and ownership respectively if that's the case.
Owner: aga...@chromium.org
Status: Started (was: Available)
Aaron and myself have been working on this, indeed :) 

Comment 20 by rmis...@google.com, Nov 30 2016

So very excited that this is coming soon..
Project Member

Comment 21 by bugdroid1@chromium.org, Nov 30 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/de3549747eff63774b8754b77246c44a32cf2b84

commit de3549747eff63774b8754b77246c44a32cf2b84
Author: Andrii Shyshkalov <tandrii@chromium.org>
Date: Wed Nov 30 16:22:26 2016

Project Member

Comment 22 by bugdroid1@chromium.org, Nov 30 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/de3549747eff63774b8754b77246c44a32cf2b84

commit de3549747eff63774b8754b77246c44a32cf2b84
Author: Andrii Shyshkalov <tandrii@chromium.org>
Date: Wed Nov 30 16:22:26 2016

Project Member

Comment 23 by bugdroid1@chromium.org, Nov 30 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/100b4ca90ad212ea926ef542893d5c2d961d7a4e

commit 100b4ca90ad212ea926ef542893d5c2d961d7a4e
Author: Andrii Shyshkalov <tandrii@google.com>
Date: Wed Nov 30 18:27:59 2016

Project Member

Comment 24 by bugdroid1@chromium.org, Nov 30 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/a317a0dcddf4443c84c9ccfa0ef4c919283eddc0

commit a317a0dcddf4443c84c9ccfa0ef4c919283eddc0
Author: Andrii Shyshkalov <tandrii@chromium.org>
Date: Wed Nov 30 18:37:28 2016

I think I caused this in my prior CL:
(from CQ log):

[I2016-11-30T13:16:36.830563-08:00 26446 139930603570944 buildbucket_util:509] 15 fetched builds reduced to 30 for GerritPendingCommit(5006, 12)


found a bug in counting number of reduced try jobs, fixed in https://chrome-internal-review.googlesource.com/308215.
Project Member

Comment 27 by bugdroid1@chromium.org, Nov 30 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/3e05dec2585a5f468b4b483e7616caf54d139d85

commit 3e05dec2585a5f468b4b483e7616caf54d139d85
Author: Andrii Shyshkalov <tandrii@chromium.org>
Date: Wed Nov 30 22:03:53 2016

Project Member

Comment 28 by bugdroid1@chromium.org, Dec 1 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infra/infra_internal.git/+/f8753b1ffa44cabd5e3dcc8a609ccbc46e507827

commit f8753b1ffa44cabd5e3dcc8a609ccbc46e507827
Author: Aaron Gable <agable@chromium.org>
Date: Wed Nov 30 22:07:58 2016

Success on my whitespace CL: https://internal-cq-status.appspot.com/v2/patch-status/chrome-internal-review.googlesource.com/308115/8

the tryjob of PS#7 was re-used https://uberchromegw.corp.google.com/i/internal.infra.try/builders/infra-internal-tester-trusty-64/builds/1310

On the CQ side, I think this is fixed. What remains to be done here is the buildbucket Gerrit plugin side.
Cc: aga...@chromium.org andyb...@chromium.org
 Issue 642861  has been merged into this issue.
Project Member

Comment 31 by bugdroid1@chromium.org, Dec 7 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/gerrit-plugins/buildbucket/+/1bc2e45144f2dbda9b4de53c12e74c1d27e5073b

commit 1bc2e45144f2dbda9b4de53c12e74c1d27e5073b
Author: Aaron Gable <agable@chromium.org>
Date: Fri Dec 02 22:27:44 2016

Add docs for testing buildbucket plugin against live data

Bug:  chromium:634944 
Change-Id: If0b841f982588efded1d25048d38ed3930cf5b88

[modify] https://crrev.com/1bc2e45144f2dbda9b4de53c12e74c1d27e5073b/README.md

Hey guys, way to go!  I think I just experienced the effects of your work on https://skia-review.googlesource.com/c/5657/.  The CQ ran bots on PS2, and PS3 (just an edit to the description) didn't re-run them.  Thanks so much!
Wahoo!

This bug should be fully fixed soon. The buildbucket plugin change to display the builds on subsequent patches is landing right now, and then we just have to import and deploy the new version.
Issue gerrit:5122 has been merged into this issue.
Project Member

Comment 35 by bugdroid1@chromium.org, Dec 12 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/gerrit-plugins/buildbucket/+/d54c9c4afcdc2243ec8d3ef66111e2976c176d6d

commit d54c9c4afcdc2243ec8d3ef66111e2976c176d6d
Author: Aaron Gable <agable@chromium.org>
Date: Thu Dec 08 01:35:31 2016

Fetch and display buildbucket jobs for prior identical patches

The commit queue now reuses buildbucket jobs that were triggered for
previous patchsets, if those previous patchsets share the same tree
objects (i.e. differ only in commit message). With this change,
the buildbucket plugin now crawls the patchset history backwards,
finding patchsets with the same diff as the currently-viewed one,
and fetches buildbucket buildsets for all of them.

BUG= 634944 

Change-Id: I46fb95cc5a65eff0243d5711aacd812ffc67dee5

[modify] https://crrev.com/d54c9c4afcdc2243ec8d3ef66111e2976c176d6d/src/main/resources/static/buildbucket.js
[modify] https://crrev.com/d54c9c4afcdc2243ec8d3ef66111e2976c176d6d/src/main/resources/static/cr-buildbucket-view.js

Blocking: -skia:5612
 Issue 677171  has been merged into this issue.
 Issue 678100  has been merged into this issue.
Status: Fixed (was: Started)
This appears to be working in the buildbucket plugin on my whitespace test change: https://chrome-internal-review.googlesource.com/c/308115
The first four patches are the same, and the second four patches are the same, and only show builds appropriate for each. Huzzah!
Thanks so much.  This has been working really smoothly for me lately.

Sign in to add a comment