New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 735548 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Aug 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

[Findit] Flake Analyzer - Improve confidence score algorithm

Project Member Reported by lijeffrey@chromium.org, Jun 21 2017

Issue description

Stepiness alone is not smart enough to determine a culprit can be found in a range. In many cases, such as https://fa2a1f56aa-dot-waterfall-frontend-dot-findit-for-me.appspot.com/waterfall/flake?key=ag9zfmZpbmRpdC1mb3ItbWVytAELEhdNYXN0ZXJGbGFrZUFuYWx5c2lzUm9vdCJ-Y2hyb21pdW0ubWVtb3J5L0xpbnV4IENocm9taXVtIE9TIEFTYW4gTFNhbiBUZXN0cyAoMSkvMjEzOTQvYnJvd3Nlcl90ZXN0cy9VR0ZuWlV4dllXUk5aWFJ5YVdOelFuSnZkM05sY2xSbGMzUXVRbUZrV0doMGJXd3ZNUT09DAsSE01hc3RlckZsYWtlQW5hbHlzaXMYAQw, the existence of a culprit is obvious to the human eye but not so much by following stepiness alone.

Some initial possible improvements:
1. Newly added tests (such as the case above) already detected to be flaky should always force try jobs with 100% confidence
2. Anywhere there's a 100% stable -> flaky (if suspected build) followed by only flaky points should have high confidence 
 
Project Member

Comment 1 by bugdroid1@chromium.org, Aug 2 2017

Status: Fixed (was: Assigned)

Sign in to add a comment