New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 791113 link

Starred by 1 user
Status: Fixed
Owner:
lijeffrey@chromium.org
Closed: Jun 2018
Cc:
█ robert...@chromium.org
chanli@chromium.org
lijeffrey@chromium.org
liaoyuke@chromium.org
st...@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

[Findit] Flake Analyzer - No confidence score

Project Member Reported by lijeffrey@chromium.org, Dec 1 2017 
https://13065-8617a6d-dot-waterfall-frontend-dot-findit-for-me.appspot.com/waterfall/flake?key=ag9zfmZpbmRpdC1mb3ItbWVyuwELEhdNYXN0ZXJGbGFrZUFuYWx5c2lzUm9vdCKEAWNocm9taXVtLndpbi9XaW4xMCBUZXN0cyB4NjQvMTgzNDgvaW50ZXJhY3RpdmVfdWlfdGVzdHMgb24gV2luZG93cy0xMC0xNDM5My9URzlqWVd4T1ZGQlZTVlJsYzNRdVJtRnJaV0p2ZUZKbFpHbHlaV04wYzFSdlQyMXVhV0p2ZUE9PQwLEhNNYXN0ZXJGbGFrZUFuYWx5c2lzGAEM

This isn't technically a bug since the code behaved as expected, but in this analysis looks like it should have decent confidence, yet no confidence score was compluted. Confidence relies on there being 5+ data points, which in this case there are too few so confidence bailed out.

Consider reducing the number of points needed, or come up with a new algorithm altogether that doesn't rely on steppiness for cases where 100% -> flaky in order to send more code review notifiations/file bugs etc

Comment 2 by lijeffrey@chromium.org, Jan 11 2018 

Also when try job data points are available, only the data points up until the culprit are considered, so it's still possible for there to be < 5 data points

Comment 3 by wylieb@chromium.org, Mar 8 2018

Owner: lijeffrey@chromium.org
Status: Assigned (was: Available)
Assigned for verification.

Comment 4 by lijeffrey@chromium.org, Jun 14 2018

Status: Fixed (was: Assigned)
All culprits now have confidence scores due to padding to create 5+ data points
►

Sign in to add a comment