Show flakiness graphs on all levels including overall, team, directory and invidivual test flakiness |
|||||
Issue descriptionCurrently we only show historical flakiness graphs for teams, e.g. https://chromiumdash.appspot.com/flakiness/layout-dev. Our users report them to be very useful, but would also like to see them on various grouping levels. In particular, it would be useful to have these graphs for individual tests to be able to see a flakiness trend of a test and detect when it has become more or less flaky. There is related work by FindIt team, which shows pass rate in their flakiness bisect, e.g. https://findit-for-me.appspot.com/waterfall/check-flake?master_name=chromium.linux&builder_name=Linux%20Tests&build_number=50039&step_name=browser_side_navigation_browser_tests&test_name=TracingBrowserTest.TestMemoryInfra.
,
Feb 16 2017
Issue 404338 has been merged into this issue.
,
Feb 16 2017
Update: I am planning on writing a proposal to unify all information about a flaky test on a single page and then linking this page from SoM, which is why I merged issue 404338 into this bug. This information will include data from: - Chromium Try Flakes - Flakiness Dashboard - FindIt - Flakiness Surface One major concern is that these systems use different ways to detect flakes and compute flakiness of test, so we'll need to clearly address that in the proposal.
,
Feb 16 2018
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue. Sorry for the inconvenience if the bug really should have been left as Available. If you change it back, also remove the "Hotlist-Recharge-Cold" label. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
Feb 16 2018
,
May 8 2018
|
|||||
►
Sign in to add a comment |
|||||
Comment 1 by serg...@chromium.org
, Dec 14 2016