Provide detailed tooltips for the columns in the tables/graphs |
|||
Issue descriptionCurrently we only have tooltips for the tables in Test Results and they are not detailed enough. In particular, make sure to describe how we get data and how do we come up with a specific number for: - historical flakiness - explain how we drop failed tests from failed builds, but use the remainder of the results - make sure to mention 1-week window and 1-month history - explain the principle of 3-tries failure rate - link to explanations in the design doc - combined flakiness - explain how we drop failed tests from failed builds, but use the remainder of the results - explain the principle of 3-tries failure rate - link to explanations in the design doc - individual flakiness - expain what that flakiness is the probability to fail - link to explanations in the design doc - flaky failures - explain two numbers are "X out of Y" - explain that Y is larger for more flaky tests due to retries - explain that we do not include flakes that may be reliable failures
,
Dec 16 2016
,
Dec 16 2016
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra.git/+/8532615110f1c3e41949b480f45e4a762558fef7 commit 8532615110f1c3e41949b480f45e4a762558fef7 Author: Sergiy Byelozyorov <sergiyb@chromium.org> Date: Fri Dec 16 16:46:24 2016 Add more detailed explanation of the columns in tooltips BUG= 674081 Change-Id: I39ae16721de754a1123c000cc581ad4accd142ca Reviewed-on: https://chromium-review.googlesource.com/420726 Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org> Reviewed-by: Andrii Shyshkalov <tandrii@chromium.org> [modify] https://crrev.com/8532615110f1c3e41949b480f45e4a762558fef7/go/src/infra/appengine/test-results/frontend/src/test-results-flakiness.html
,
Dec 17 2016
Update: just deploy CL from #3 to test-results. We still need to add detailed tooltips for chromiumdash, but that should be done after issue 670329 is finished.
,
Dec 17 2016
,
Jan 11 2017
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra.git/+/b389b88a17312d6b3730f377826d2c3a84f8eda9 commit b389b88a17312d6b3730f377826d2c3a84f8eda9 Author: Sergiy Byelozyorov <sergiyb@chromium.org> Date: Tue Jan 10 14:42:50 2017 Clarify which failures in the tooltip BUG= 674081 Change-Id: I94326e57b8765715001006e5d5be8e422f84a51f Reviewed-on: https://chromium-review.googlesource.com/426070 Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org> Reviewed-by: Andrii Shyshkalov <tandrii@chromium.org> [modify] https://crrev.com/b389b88a17312d6b3730f377826d2c3a84f8eda9/go/src/infra/appengine/test-results/frontend/src/test-results-flakiness.html
,
Jan 11 2017
We've added tooltips both to chromiumdash and test-results.
,
Jan 11 2017
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra.git/+/48a3ca179ca53047fa576439f58b3625a0116fb2 commit 48a3ca179ca53047fa576439f58b3625a0116fb2 Author: Sergiy Byelozyorov <sergiyb@chromium.org> Date: Wed Jan 11 11:55:45 2017 Add link to the design doc with more detailed explanations BUG= 674081 Change-Id: Ib6949a9ea19784a289a6e737c03e558c482a0b4b Reviewed-on: https://chromium-review.googlesource.com/427099 Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org> Reviewed-by: Paweł Hajdan Jr. <phajdan.jr@chromium.org> [modify] https://crrev.com/48a3ca179ca53047fa576439f58b3625a0116fb2/go/src/infra/appengine/test-results/frontend/src/test-results-flakiness.html |
|||
►
Sign in to add a comment |
|||
Comment 1 by serg...@chromium.org
, Dec 14 2016