New issue
Advanced search Search tips

Issue 712087 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 711733
Owner: ----
Closed: Apr 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

Sheriff-o-matic shows incorrect failing tests

Project Member Reported by jparent@chromium.org, Apr 17 2017

Issue description

1. SoM says 41 tests are failing on chromium.webkit/WebKit Mac10.9, for example, the second test is compositing/gestures/gesture-tapHighlight-1-iframe-composited-scrolled-clipped.html (see screenshot #1).

2. Click through to results on flakiness dashboard to investigate.  The test is marked WONTFIX so it isn't even being run (see screenshot #2).

3. Click through to the actual builder and see that only 1 test is actually failing (see screenshot #3)

...

Issues:
1) Why is this test mentioned in #1 above shown as failing, when it isn't running?
2) Why does the top link on SoM say "...... too many results, data snipped.... ( Code Search )" which is a link that doesn't work?
3) Why does SoM think 41 tests are failing when there is only one failing test? (virtual/disable-spinvalidation/paint/invalidation/text-match-document-change.html)

 
Screen Shot 2017-04-16 at 9.02.28 PM.png
87.6 KB View Download
Mergedinto: 711733
Status: Duplicate (was: Untriaged)
Fixed this last week, but we could do a push today if this it's urgent.
I think it is worth a push - makes sheriffing very hard, and decreases user
trust in the data .

Sign in to add a comment