New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 618351 link

Starred by 1 user

Issue metadata

Status: Duplicate
Owner:
Closed: Dec 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug

Blocking:
issue 580554



Sign in to add a comment

SoM: Support for chromeos internal waterfalls

Project Member Reported by steve...@chromium.org, Jun 8 2016

Issue description

In order for Sheriff-o-matic to be useful to chrome on chromeos gardeners, we need access to the following internal waterfalls:

https://uberchromegw.corp.google.com/i/chromeos.chrome/waterfall
https://uberchromegw.corp.google.com/i/chromeos/waterfall
  (specifically, builder=master-chromium-pfq and builder=*-chrome-pfq + builder=*-chromium-pfq)


 
Components: Infra>SheriffOMatic
Labels: Hotlist-CrOS-Gardener
Owner: seanmccullough@chromium.org
Gardening chrome on chromeos is challenging at the best of times. We are hoping to rally around SoM to build gardening tools, however without access to the internal waterfalls SoM is not very useful for gardening.

In particular the pfq-informational builders which usually reveal chrome on chromeos failures first are split between https://build.chromium.org/p/chromiumos.chromium/waterfall and https://uberchromegw.corp.google.com/i/chromeos.chrome/waterfall, so having access to just the chromiumos.chromium is confusing at best).

Sean, I am assigning this to you for now to ask the pertinent questions and help drive this effort.

Status: Assigned (was: Available)
Sean, you mentioned that there was additional information required for this, can you list the details we need to move this forward?

Which vlan is your internal master running on?
Owner: akes...@chromium.org
akeshet@ can you answer comment #4 or reassign?

Go ahead and reassign to me once answered, thanks!

Components: Infra>Sheriffing>SheriffOMatic
Components: -Infra>Sheriffing
Owner: seanmccullough@chromium.org
Comment #4 I don't know. You mean waterfall master? The chrome infra team handles that for us, so perhaps you can answer the question.
Cc: benhenry@chromium.org
+benhenry@ - I know chrome infra is swamped but this has been blocking us for a while now. It sounds like someone needs to do a bit of digging but I'm not sure who that person should be.

Your masters are on vlan 2. See https://chrome-internal.googlesource.com/chrome/tools/build_limited/scripts/slave/+/master/gatekeeper_trees_chromeos.json, and how the master names start with master2a and 2b.

In order to get the data, you need to run a copy of alerts-dispatcher, which will poll your buildbot masters, and then upload the data to sheriff-o-matic.

Look at https://chrome-internal.googlesource.com/chrome/tools/build.git/+/master/masters/master.official.infra.cron/builders.pyl (and the associated CLs I wrote to set that up) for how to set this up.

You might also need to modify the alerts dispatcher code to poll your masters directly, since it tries to talk to Chrome Build Extract first, before polling masters, and it currently uses a whitelist to decide what to poll (in https://chromium.googlesource.com/infra/infra/+/master/go/src/infra/monitoring/client/client.go#220). 

Once you have that builder up and running, it should be fairly simple to get the data showing up on the new sheriff-o-matic frontend (live at https://sheriff-o-matic-staging.appspot.com. We still need to move this to prod).

I don't think I have time to do all of this, sadly, but tiffany or sean or someone else might.
Owner: zhangtiff@chromium.org
Assigning to Tiffany.
Owner: martiniss@chromium.org
I'm working on this now.
Cc: d...@chromium.org
Labels: Milestone-PostSoMNG
(assigning milestones)
Labels: -Milestone-PostSoMNG Milestone-CrOS
Ping - please provide an update to your high priority bug. This bug is stale. Is it really P-1?
Owner: ----
Status: Available (was: Assigned)
I haven't worked on this in a long time.

Sean, someone else has been doing work on ChromeOS, right?
Yes, you may be able  to resolve this as a duplicate of issue 639901 at this point, although there may (or may not) be additional work to do to add builders from the following waterfalls to SoM:

https://chromegw.corp.google.com/i/chromeos.chrome/waterfall

https://build.chromium.org/p/chromiumos.chromium/waterfall

Owner: seanmccullough@chromium.org
Assigning back to Sean to see if this bug can be closed or not.
Mergedinto: 639901
Status: Duplicate (was: Available)

Sign in to add a comment