New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 637965 link

Starred by 2 users

Issue metadata

Status: Available
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: 2017-04-01
OS: ----
Pri: 1
Type: Bug

Blocking:
issue 635723
issue 637891


Participants' hotlists:
speed-ops-backlog


Sign in to add a comment

Need tests to verify perfbot setup

Project Member Reported by sullivan@chromium.org, Aug 15 2016

Issue description

We've seen issues in bug 637891 and bug 635723 where perfbots are not set up and configured correctly. We need to add clear tests to turn bots purple if they are not set up right.

Initial design doc, still considering approaches:
https://docs.google.com/a/google.com/document/d/193P7NMjD1NJo1AtcvAWxexO-cDku8EWi2u0XIpqxb4c/edit?usp=sharing
 

Comment 1 by benhenry@google.com, Aug 15 2016

I think this is going to have to be something we talk to friedman and vhang about.
Cc: friedman@chromium.org vhang@chromium.org
Adding friedman and vhang

I think there are 3 parts to this:
1) Documenting what we expect to be set up
2) Ensuring puppet or some other automated system does that setup
3) Making the build fail if 1) and 2) didn't happen correctly.

This bug is about 3). I know friedman and vhang will definitely need to be deeply involved in 1) and 2). What about 3?
Cc: eyaich@chromium.org
+Emily since this has some implication for swarming too.
Status: Assigned (was: Untriaged)
wrt Comment 2, I think we'll just need to define something in your recipe that tests all of those assumptions. /me figures it's time to learn more about recipes.

Annie - let's set up a meeting when Elliott's back in SFO.
Update: The initial design doc got pretty muddled, replacing with: https://docs.google.com/document/d/1b6E0MZqw0Etw0u6B_i0_ekV6kCWdiCd2EbzJA5P-3pk/edit#
Labels: need-labs-startup
Ping - please provide an update to your high priority bug. This bug is stale. Is it really P-1?
NextAction: 2016-12-06
NextAction: 2017-04-01
Annie - what do we do with this? I feel like we're going to need to dedicate people to it, so punting to next Q.
Yeah, I think we have to punt this to next quarter.
Components: Speed>Benchmarks>Waterfall
Labels: -Performance-Waterfall
Owner: ----
Status: Available (was: Assigned)

Sign in to add a comment