wmatrix has confusing color scheme |
||||
Issue descriptionhttps://wmatrix.googleplex.com/retry_teststats/?days_back=30&tests=network_DefaultProfileCreation When a test has a successful retry rate, it shows red while an unsuccessful retry rate displays green. It's probably more intuitive the other way around.
,
Mar 22 2016
ah, that's true, should the status be red then when clicking on the test link? like https://wmatrix.googleplex.com/testrun/?test_ids=275435922
,
Mar 22 2016
or should status say flaky instead of good?
,
Mar 22 2016
the link shows you the result of the "retry" which passed. If you click "Retry of 275431038" at the bottom, it will direct to the one that failed. Maybe the "Retry of 275431038" should be highlighted.
,
Mar 22 2016
ahhh.... ok, now I get it. Sorry for the pestering, chalk this up to user error.
,
Mar 23 2016
How about this one? https://wmatrix.googleplex.com/retry_teststats/?days_back=30&tests=platform_Perf veyron_minnie-cheets has green background (so... good?), but if you click on it, it turns out that is has never passed (so... bad!).
,
Mar 23 2016
If a test never passes, it means it is stable (not flaky) and reflects real problems, it is actually a good thing from the test flakiness' perspective.
,
Mar 23 2016
Test flakiness and test failures are two different concepts. We do have another test health dashboard https://wmatrix.googleplex.com/testhealth/unfiltered/?days_back=7 which indicates which tests fail more often. But keep in mind, "fail more often" != "flaky".
,
Mar 24 2016
Awesome, I was looking for something like that :)
,
Apr 27 2016
|
||||
►
Sign in to add a comment |
||||
Comment 1 by fdeng@chromium.org
, Mar 22 2016Status: WontFix (was: Untriaged)