default step name for flakiness dashboard is the wrong webkit tests |
||
Issue descriptionIt took me a long time to understand why my flakes weren't showing up in the flakiness dashaboard. It turned out it was because the step name by default is webkit_layout_tests (the randomorder steps only!) instead of webkit_tests. Could we rename that step to webkit_randomorder_tests and keep webkit_tests as the default in the dashboard?
,
Apr 20 2017
@ojan, when you say that the step name by default is webkit_layout_tests, is that because you're loading the flakiness dashboard via a URL that specifies testType=webkit_layout_tests? We updated a bunch of links to the flakiness dashboard, but it would be useful to know how you're arriving at this state. As Erik mentioned, the step name we're using for swarmed layout tests is "webkit_layout_tests", which is live on the RandomOrder and linux_chromium_rel_ng bots. It looks like the latter is visible on the flakiness dashboard under the test type "webkit_layout_tests (with patch)", so defaulting to "webkit_layout_tests" is probably not useful right now, as it surfaces only the RandomOrder results. I'll look at rolling back the default to webkit_tests for now, but at some point we will want to roll it forward again, once we've migrated the rest of the builders.
,
May 4 2018
@tansell: I think that this is obsolete now. Can you verify and close? |
||
►
Sign in to add a comment |
||
Comment 1 by estaab@chromium.org
, Apr 19 2017Status: Assigned (was: Untriaged)