New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 836430 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Apr 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: ----



Sign in to add a comment

Findit failed to pull logdog streams for Luci builds

Project Member Reported by st...@chromium.org, Apr 24 2018

Issue description

Page URL: https://findit-for-me.appspot.com/waterfall/build-failure?url=https://luci-milo.appspot.com/buildbot/chromium.linux/Linux%20Builder%20(dbg)/123643&debug=1

 Description:

If there is no failure, we will have less chance of false positives, because in that case we will not do a full compile and instead just compile the failed target.

https://bugs.chromium.org/p/chromium/issues/detail?id=836348
 

Comment 1 by chanli@chromium.org, Apr 24 2018

Owner: chanli@chromium.org
Status: Assigned (was: Available)
I will look into it

Comment 2 by st...@chromium.org, Apr 24 2018

Chan, mind investigating further down here?

Comment 3 by chanli@chromium.org, Apr 24 2018

It appears there is a recent change on the LogDog path format for LUCI builds:

Previous: "bb/{master_name}/{builder_name}/{build_number}/+/annotations"
Now: "buildbucket/cr-buildbucket.appspot.com/build_id/+/annotations"








Comment 4 by st...@chromium.org, Apr 25 2018

Cc: no...@chromium.org tandrii@chromium.org
Components: -Tools>Test>FindIt>Waterfall Tools>Test>FindIt
Summary: Findit failed to pull logdog streams for Luci builds (was: Findit failed to pull failure log (stdio or ninja output) of step compile of master chromium.linux)
+nodir +tandrii in case there are other changes as well

Comment 5 by no...@chromium.org, Apr 25 2018

this change isn't recent. This is the format of logdog prefixes used in LUCI builds for 6mo+.

Ideally FindIt does not hard code the logdog stream format. The buildbucket API returns it. For example, in https://cr-buildbucket.appspot.com/_ah/api/buildbucket/v1/builds/8948260456238727472
you can see "swarming_tag:log_location:logdog://logs.chromium.org/chromium/buildbucket/cr-buildbucket.appspot.com/8948260456238727472/+/annotations"
build api v2 will return the logdog stream prefix too.

Comment 6 by chanli@chromium.org, Apr 25 2018

Hi Nodir, about your suggestion: what should be the best way to get buildbucket_id for a LUCI build currently?  My plan is to get buildbucket property from milo's GetBuildbotBuildJSON API. Is there an easier way to do that?

And also, do you have any suggestion on what could be the best way to get log_location for a buildbot build? I see log_location property in buildbot builds, maybe I should directly use that?

Comment 7 by no...@chromium.org, Apr 25 2018

I think you could reuse the code that you already wrote to fetch the buildbucket build using buildbucket search api and build_address tag, unless making one more RPC is a problem in that code path

Comment 8 by chanli@chromium.org, Apr 25 2018

This is for LUCI build right? what about buildbot build? 

Comment 9 by no...@chromium.org, Apr 25 2018

Nothing changed for Buildbot build. The problem is specific to LUCI, right?
Right. I was thinking to find a way to handle both LUCI builds and buildbot builds. But it sgtm to not invest too much for buildbot builds but rather use the old function.
Cc: seanmccullough@chromium.org
We may still have a problem: for analysis requested by SoM, Findit gets a master_url in the format as: http://build.chromium.prg/p/chromium.mac, so Findit can gets the buildbot master_name directly without query buildbucket.search(Or even we couldn't because the lack of bucket info in request).

+seanmccullough to check how easy is the change to also include bucket info in request to Findit.

In the meantime, I'm thinking should using the suboptimal solution I mentioned in #6 for a quick fix, because this bug is blocking Findit to auto-revert compile culprits. 

Comment 12 by no...@chromium.org, Apr 26 2018

retrieving build id from buildbucket property is fine too. That is not going to change.
Status: Fixed (was: Assigned)

Sign in to add a comment