New issue
Advanced search Search tips

Issue 670329 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Jan 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: ----

Blocking:
issue 674081



Sign in to add a comment

Many tests have flakiness 1.76% and 2.83% - investigate whether this makes sense

Project Member Reported by serg...@chromium.org, Dec 1 2016

Issue description

Components: -Infra Infra>Flakiness
Summary: Many tests have flakiness 1.76% and 2.83% - investigate whether this makes sense (was: Many tests have flakiness 1.76% - investigate whether this makes sense)
Turns out the approximation formula for true flakiness is wrong. After some thinking I think we should display raw data to the user with an explanation that we omit some flaky failures as we filter out runs where all tries fail.
Status: Fixed (was: Assigned)
CL correcting computation for flakiness: http://cl/141753209.
CL adding fields for total flakes and total tries: http://cl/141563478.

CL showing total flakes and tries in the Flakiness Surface page: https://chromium-review.googlesource.com/c/416860/.

All CLs have been landed and deployed. Closing as Fixed. Please feel free to re-open if you'd like me to change information shown on the page.
Status: Started (was: Fixed)
I'm going to re-open this as I'm adding total flaky-failures and skipped-tests to the chromiumdash page.
We'll also need to add another table to compute data for row with "all tests", but perhaps we need to rethink the whole structure of tables to make it faster and more flexible.
Update: For some reason deployment to chromiumdash AE app didn't work. Also we still need to find a solution for #7.
Blocking: 674081

Comment 11 Deleted

> We'll also need to add another table to compute data for row with "all tests", but perhaps we need to rethink the whole structure of tables to make it faster and more flexible.

I have found a relatively easy to way to achieve this in the current table configuration, but we may still need to revisit this when created in-line graphs as part of the issue 674078.
Status: Fixed (was: Started)
Latest version of chromiumdash now shows raw values as well.

Sign in to add a comment