New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 713238 link

Starred by 0 users

Issue metadata

Status: Assigned
Owner:
Last visit > 30 days ago
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: ----



Sign in to add a comment

default step name for flakiness dashboard is the wrong webkit tests

Project Member Reported by ojan@chromium.org, Apr 19 2017

Issue description

It took me a long time to understand why my flakes weren't showing up in the flakiness dashaboard. It turned out it was because the step name by default is webkit_layout_tests (the randomorder steps only!) instead of webkit_tests.

Could we rename that step to webkit_randomorder_tests and keep webkit_tests as the default in the dashboard?
 

Comment 1 by estaab@chromium.org, Apr 19 2017

Owner: mcgreevy@chromium.org
Status: Assigned (was: Untriaged)
I think the new name for webkit_tests will be webkit_layout_tests after they're swarmed on all platforms and the linux ones should already be using the new name. Adding mcgreevy@ too to see if anything can be done about random order tests in the mean time.
@ojan, when you say that the step name by default is webkit_layout_tests, is that because you're loading the flakiness dashboard via a URL that specifies testType=webkit_layout_tests?  We updated a bunch of links to the flakiness dashboard, but it would be useful to know how you're arriving at this state.

As Erik mentioned, the step name we're using for swarmed layout tests is "webkit_layout_tests", which is live on the RandomOrder and linux_chromium_rel_ng bots. It looks like the latter is visible on the flakiness dashboard under the test type "webkit_layout_tests (with patch)", so defaulting to "webkit_layout_tests" is probably not useful right now, as it surfaces only the RandomOrder results.  I'll look at rolling back the default to webkit_tests for now, but at some point we will want to roll it forward again, once we've migrated the rest of the builders. 
Owner: tansell@chromium.org
@tansell: I think that this is obsolete now.  Can you verify and close?

Sign in to add a comment