Clean up accumulated pending builds |
||||
Issue descriptionSome masters have hundreds of thousands of pending builds accumulating over several months: http://shortn/_KCooJosOHx Clearing these pending builds reduces latency, since the master has to load them for every json api request: http://shortn/_jKGURJnfl0 We should: 1) Delete or fix the builders that are currently broken and accumulating pending builds. 2) Alert when a new builder gets over some stupidly high number of pending builds (5-10k). 3) Add pending build garbage-collection to buildbot, so it will expire old pending builds when the queue is over some size.
,
Jun 16 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/tools/build.git/+/e8698e7a48fd5051e0088e05b8200bbda67e3f26 commit e8698e7a48fd5051e0088e05b8200bbda67e3f26 Author: dsansome <dsansome@chromium.org> Date: Thu Jun 16 04:15:33 2016 Delete the builders on master.chromium.swarm that have been offline for months. BUG= 620206 Review-Url: https://codereview.chromium.org/2068023003 [modify] https://crrev.com/e8698e7a48fd5051e0088e05b8200bbda67e3f26/masters/master.chromium.swarm/master.cfg [modify] https://crrev.com/e8698e7a48fd5051e0088e05b8200bbda67e3f26/masters/master.chromium.swarm/slaves.cfg
,
Jun 28 2016
https://codereview.chromium.org/2091643002 should put an upper bound on the number of pending builds held in the database.
,
Jul 26 2016
changeHorizon only affects changes that come from changesources, not buildrequests that are pushed to the master. I'll need to implement my own cleanup mechanism for buildrequests.
,
Jul 6 2017
,
Jul 6
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue. Sorry for the inconvenience if the bug really should have been left as Available. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
Jul 10
|
||||
►
Sign in to add a comment |
||||
Comment 1 by dsansome@chromium.org
, Jun 15 2016