Flake detection: Group different flaky tests with the same root cause |
|||
Issue descriptionJohn mentioned that there was a time a bunch of tests started failing together and they have similar stack trace. It would make sense to group them together to dedup. Two ideas were brought up to identify them: 1. Parse the log (stack trace) to understand the root cause. 2. Inspect the occurrence history: if two tests started being flaky around the same time and always fail together, then it's very like that they have the same root cause. A similar problem in Flake Analyzer: crbug.com/850319 . Solutions can potentially be shared between Flake Detection and Flake Analyzer.
,
Jun 7 2018
,
Aug 2
,
Dec 27
Issue 916598 has been merged into this issue.
,
Dec 27
We have a simple heuristic for grouping flakes now: if they are in the same step and happen together. |
|||
►
Sign in to add a comment |
|||
Comment 1 by liaoyuke@chromium.org
, Jun 7 2018Status: Assigned (was: Untriaged)
Summary: Flake detection: Group different flaky tests with the same root cause (was: Group different flaky tests with the same root cause)