Experiment with reporting all infra step flakes to troopers and normal step flakes to sheriffs |
|||||
Issue descriptionEven though they *are* flakes from a user's perspective, they're non-actionable noise for sheriffs and are definitely infra failures. For example: https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMAsSBUZsYWtlIiV0ZWxlbWV0cnlfcGVyZl91bml0dGVzdHMgKHdpdGggcGF0Y2gpDA
,
May 27 2017
I was planning to experiment with sending all infra step flakes to troopers, but this can only be done after a rewrite. Looks like we do no have a file for this one file yet.
,
May 27 2017
This can probably be done by placing failure type into "Config" field. If it will turn out to be useful, we can create a new field for this.
,
May 29 2017
This is blocked on another rewrite for now and I won't be working on it immediately, so I'll move it into available.
,
May 31 2017
Another example: https://bugs.chromium.org/p/chromium/issues/detail?id=727982
,
Jun 1 2018
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue. Sorry for the inconvenience if the bug really should have been left as Available. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
Jun 14 2018
CTF is not reporting flaky test steps now. We could revisit that in the new flake detection. But I'd close this bug for now. |
|||||
►
Sign in to add a comment |
|||||
Comment 1 by jbudorick@chromium.org
, May 26 2017