New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 600075 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner:
Closed: Jun 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug

Blocked on:
issue 600082



Sign in to add a comment

Get more spare builders for CrOS infra paladin builders

Project Member Reported by sosa@google.com, Apr 2 2016

Issue description

Right now we have 1 extra paladin builder on the waterfall which comes really in handy when a paladin builder dies.

However, we have over 50 paladin targets and it's becoming more often that a few builders are dead and cause a commit queue outage. In fact, in the last 2 weeks, we've lost 5 builders which has caused 2 partial outages.

I suggest we add at least 3 more backup builders to ensure we can always keep throughput up in the presence of machine failures.


 

Comment 1 by d...@chromium.org, Apr 2 2016

Owner: d...@chromium.org
Status: Started (was: Untriaged)
I'll go ahead and put 3 up, but baremetal slaves are a fairly expensive resource to sit around idle. If more builders are added and we haven't moved to GCE yet, we will have to reevaluate this decision.
Project Member

Comment 2 by bugdroid1@chromium.org, Apr 2 2016

The following revision refers to this bug:
  http://goto.ext.google.com/viewvc/chrome-internal?view=rev&revision=86040

------------------------------------------------------------------
r86040 | dnj@google.com | 2016-04-02T02:53:05.392423Z

-----------------------------------------------------------------

Comment 3 by d...@chromium.org, Apr 2 2016

Blockedon: 600082

Comment 4 by d...@chromium.org, Apr 2 2016

Status: Fixed (was: Started)

Comment 5 by d...@chromium.org, Apr 5 2016

Owner: ----
Status: Available (was: Fixed)
This ended up being a really bad change. The floating builder algorithm is not happy with more than one floating builder. Reverted and left available ATM b/c a lot of broken slaves have also happened and I have nothing extra to offer anymore.

Comment 6 by autumn@chromium.org, Apr 11 2016

Owner: sosa@chromium.org

Comment 7 by benhenry@google.com, Apr 26 2016

Components: Infra>Client>ChromeOS
Labels: -Infra-ChromeOS
Project Member

Comment 8 by sheriffbot@chromium.org, Jun 3 2016

Labels: Hotlist-Google
Project Member

Comment 9 by sheriffbot@chromium.org, Jun 5 2017

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available. If you change it back, also remove the "Hotlist-Recharge-Cold" label.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Cc: sosa@chromium.org
Labels: -Pri-1 Pri-2
Owner: dgarr...@chromium.org
Reassigning and de-prioritizing.

Don, still relevant?
Status: WontFix (was: Untriaged)
We currently have two spares, and swarming will remove the need for dedicated spares.

Sign in to add a comment