New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 798887 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Jan 4
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

[Findit] Flake Analyzer - Handle non-existent step case

Project Member Reported by wylieb@chromium.org, Jan 3 2018

Issue description

Cases:
(1) Build is green, step not there
(2) Build is red, step is there
(3) Build is red, step is not there

In case (1) & (3) this can be test not found.
In case (2), this should be bailed out or 0% pass rate.
 
Possibility is to use information from the builder that compiles the test binary.

Comment 2 by st...@chromium.org, Jan 4 2018

hm, I thought the conclusion is: (maybe I'm wrong, but double check)
1. If there is at least one Swarming task triggered for the step in question, use that build as valid one.
2. If no Swarming task, mark that as invalid build.
3. If no valid builds in between, bail out with clear error message.

Regarding the idea to use info from builder (Mac Builder) instead of the tester (Mac 10.9 Tests, etc), it needs more investigation and we still need to deal with new test-target (kinda ~= non-existent step).
This bug is describing the fix for this if we ever want to do anything more than setting the error and bailing out.
Project Member

Comment 4 by sheriffbot@chromium.org, Jan 4

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Status: WontFix (was: Untriaged)
This seems safe to be closing out.

Sign in to add a comment