[Findit] Flake Analyzer - Handle non-existent step case |
|||
Issue descriptionCases: (1) Build is green, step not there (2) Build is red, step is there (3) Build is red, step is not there In case (1) & (3) this can be test not found. In case (2), this should be bailed out or 0% pass rate.
,
Jan 4 2018
hm, I thought the conclusion is: (maybe I'm wrong, but double check) 1. If there is at least one Swarming task triggered for the step in question, use that build as valid one. 2. If no Swarming task, mark that as invalid build. 3. If no valid builds in between, bail out with clear error message. Regarding the idea to use info from builder (Mac Builder) instead of the tester (Mac 10.9 Tests, etc), it needs more investigation and we still need to deal with new test-target (kinda ~= non-existent step).
,
Jan 4 2018
This bug is describing the fix for this if we ever want to do anything more than setting the error and bailing out.
,
Jan 4
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue. Sorry for the inconvenience if the bug really should have been left as Available. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
Jan 4
This seems safe to be closing out. |
|||
►
Sign in to add a comment |
|||
Comment 1 by wylieb@chromium.org
, Jan 3 2018