New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 882637 link

Starred by 1 user

Issue metadata

Status: Started
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: 2018-11-09
OS: iOS
Pri: 1
Type: Bug


Participants' hotlists:
bling-infra-backlog


Sign in to add a comment

test results of different test steps are uploaded under the same step name

Project Member Reported by st...@chromium.org, Sep 10

Issue description

This happens mostly on ios-simulator. The problem here might be "test (with patch)" is uploaded as "test".

See sample here in this query for data in the last 14 days.
https://bigquery.cloud.google.com/results/findit-for-me:US.bquijob_b4a096e_165c5a1a705
 
Cc: sergeybe...@chromium.org smut@chromium.org
Components: -Infra>Client>Chrome Infra>Client>iOS
I'm not very familiar with how the ios recipe works. https://ci.chromium.org/p/chromium/builders/luci.chromium.try/ios-simulator/89737 is a sample build I looked at; there are multiple steps with "components_unittests" in the name. They seem to be uploaded differently.

Sana or Sergey, do you know more about this?
Cc: dpranke@chromium.org
Does ios use a separate recipe? It would be great if we could resolve the inconsistent naming here.
iOS try bots use this recipe:
https://chromium.googlesource.com/chromium/tools/build/+/master/scripts/slave/recipes/ios/try.py

Can you give an example build with incorrect uploaded test results? I don't know what to make of the query.
I see. "Upload test-results" steps don't encode platform information in their step name.

Here's an example from the spreadsheet:
https://ci.chromium.org/p/chromium/builders/luci.chromium.try/ios-simulator/90617

Compare steps #198 and #217:
#198 name: "Upload test-results [component_unittests]"
#217 name: "Upload test-results [components_unittests] (2)"
Step names do differ, but the difference is outside the brackets. We should encode platform information. e.g. "Upload test-results [components_unittests (iPhone 6s iOS 12.0)]" instead of "Upload test-results [components_unittests] (2)".
Components: -Infra>Client>iOS Infra>Client>Chrome
Labels: OS-iOS
Infra>Client>iOS is dead; all of its issues should be filed in I>C>C labeled with "iOS".

Owner: jbudorick@chromium.org
Status: Started (was: Untriaged)
NextAction: 2018-11-09
Will check on this once #9 has been live for > 2 weeks.
The NextAction date has arrived: 2018-11-09

Sign in to add a comment