New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 596939 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Mar 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 3
Type: Bug



Sign in to add a comment

wmatrix has confusing color scheme

Project Member Reported by kevcheng@chromium.org, Mar 22 2016

Issue description

https://wmatrix.googleplex.com/retry_teststats/?days_back=30&tests=network_DefaultProfileCreation

When a test has a successful retry rate, it shows red while an unsuccessful retry rate displays green. It's probably more intuitive the other way around.
 

Comment 1 by fdeng@chromium.org, Mar 22 2016

Cc: kevcheng@chromium.org
Status: WontFix (was: Untriaged)
this is working as intended. 100% retry passing rate means the test is "very flaky" -- you can always retry it to make it pass. 
ah, that's true, should the status be red then when clicking on the test link?

like https://wmatrix.googleplex.com/testrun/?test_ids=275435922
or should status say flaky instead of good?  

Comment 4 by fdeng@chromium.org, Mar 22 2016

the link shows you the result of the "retry" which passed. If you click "Retry of	275431038" at the bottom, it will direct to the one that failed. Maybe the "Retry of 275431038" should be highlighted. 
ahhh.... ok, now I get it.  Sorry for the pestering, chalk this up to user error.
Status: Available (was: WontFix)
How about this one? https://wmatrix.googleplex.com/retry_teststats/?days_back=30&tests=platform_Perf

veyron_minnie-cheets has green background (so... good?), but if you click on it, it turns out that is has never passed (so... bad!).

Comment 7 by fdeng@chromium.org, Mar 23 2016

If a test never passes, it means it is stable (not flaky) and reflects real problems, it is actually a good thing from the test flakiness' perspective. 

Comment 8 by fdeng@chromium.org, Mar 23 2016

Test flakiness and test failures are two different concepts. We do have another test health dashboard
  https://wmatrix.googleplex.com/testhealth/unfiltered/?days_back=7
which indicates which tests fail more often. But keep in mind, "fail more often" != "flaky".

Status: WontFix (was: Available)
Awesome, I was looking for something like that :)
Components: Infra>Client>ChromeOS
Labels: -Infra-ChromeOS

Sign in to add a comment