Merge fixed number of builds on buildbot |
||
Issue descriptionRight now, buildbot only allows to merge none or merge all builds. To get to smaller revision ranges on bots that merge all, or to increase throughput on bots that merge none, we should implement a simple trigger recipe that merges a fixed number of other triggers. Prototype suggestion: Phase 1) Add a recipe that just triggers a particular bot, preserving all properties (like changelist, etc). Wire this recipe in between the original trigger and the original bot to be triggered. Phase 2) Let the recipe dump its state to disk when triggered by a poller or bot (trigger A). Invoke the recipe every x minutes by a nightly scheduler (trigger B) and let it fire all triggers from the dumped state. Except a delay, there shouldn't be any observable difference for the triggered bot yet. Phase 3) Let the recipe only trigger a fixed maximum or minimum number of builds. It needs to keep track of the number of builds it received in a certain time intervall.
,
Oct 13 2016
Simple alternative: https://codereview.chromium.org/2415703004/
,
Oct 14 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/tools/build.git/+/34603b7a540ae40089ddce69aecedf2f6783c7ae commit 34603b7a540ae40089ddce69aecedf2f6783c7ae Author: machenbach <machenbach@chromium.org> Date: Fri Oct 14 07:44:54 2016 Enable merging buildbot builds dependent on queue length This enhances custom mergeRequests functions with additional parameters for the number of unclaimed builds in the queue and the number of already merged builds. This allows writing more flexible merge strategies, e.g.: - Avoid huge blame lists during peak hours that stem from the standard merge-all strategy. - Avoid huge backlog on bots using the merge-none strategy. This also adds an example FYI bot from V8 to test the new feature. BUG= 654749 TEST=Tested on a local master stressed with fake commits. Review-Url: https://codereview.chromium.org/2415703004 [modify] https://crrev.com/34603b7a540ae40089ddce69aecedf2f6783c7ae/masters/master.client.v8/master.cfg [modify] https://crrev.com/34603b7a540ae40089ddce69aecedf2f6783c7ae/third_party/buildbot_8_4p1/buildbot/process/builder.py
,
Oct 14 2016
The following revision refers to this bug: https://chrome-internal.googlesource.com/infradata/master-manager.git/+/f17ff672f7a216b52d30dbc2efeb8c48db85a904 commit f17ff672f7a216b52d30dbc2efeb8c48db85a904 Author: machenbach <machenbach@google.com> Date: Fri Oct 14 07:56:20 2016
,
Oct 14 2016
The following revision refers to this bug: https://chrome-internal.googlesource.com/chrome/tools/build/+/eb29e01f83046b8d569dcf899ede5a91b9eb64f6 commit eb29e01f83046b8d569dcf899ede5a91b9eb64f6 Author: machenbach <machenbach@google.com> Date: Fri Oct 14 08:50:47 2016
,
Oct 14 2016
The following revision refers to this bug: https://chrome-internal.googlesource.com/infradata/master-manager.git/+/d1d6f5c38b7e436ec189ae8a677b588fa3492a22 commit d1d6f5c38b7e436ec189ae8a677b588fa3492a22 Author: machenbach <machenbach@google.com> Date: Fri Oct 14 08:55:52 2016
,
Mar 1 2017
|
||
►
Sign in to add a comment |
||
Comment 1 by machenb...@chromium.org
, Oct 12 2016