New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 850714 link

Starred by 2 users

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug

Blocking:
issue 837855



Sign in to add a comment

Flake detection: Group different flaky tests with the same root cause

Project Member Reported by liaoyuke@chromium.org, Jun 7 2018

Issue description

John mentioned that there was a time a bunch of tests started failing together and they have similar stack trace. It would make sense to group them together to dedup.

Two ideas were brought up to identify them:

1. Parse the log (stack trace) to understand the root cause.
2. Inspect the occurrence history: if two tests started being flaky around the same time and always fail together, then it's very like that they have the same root cause.

A similar problem in Flake Analyzer:  crbug.com/850319 . Solutions can potentially be shared between Flake Detection and Flake Analyzer.
 
Owner: jbudorick@chromium.org
Status: Assigned (was: Untriaged)
Summary: Flake detection: Group different flaky tests with the same root cause (was: Group different flaky tests with the same root cause)
John, can you provide the example you mentioned?
Description: Show this description
Labels: flake-detection
 Issue 916598  has been merged into this issue.
We have a simple heuristic for grouping flakes now: if they are in the same step and happen together. 


Sign in to add a comment