New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 856371 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug

Blocking:
issue 837855



Sign in to add a comment

Some of the webkit layout test results were missing from the test-results table

Project Member Reported by liaoyuke@chromium.org, Jun 25 2018

Issue description

https://ci.chromium.org/p/chromium/builders/luci.chromium.try/win7_chromium_rel_ng/23280, with build id: 8942949908952105104, shows that:

webkit_layout_tests (with patch) Run on OS: 'Windows-7-SP1'
Max shard duration: 0:18:21.866855 (shard #6)
Min shard duration: 0:08:25.819312 (shard #11)
Total tests: 79309
* Passed: 66453 (66371 expected, 82 unexpected)
* Skipped: 10294 (10294 expected, 0 unexpected)
* Failed: 2490 (2433 expected, >>>57 unexpected<<<)
* Flaky: 72 (72 expected, 0 unexpected)

Unexpected Failures:
* http/tests/cache/history-only-cached-subresource-loads.html
* http/tests/cache/loaded-from-cache-after-reload.html

So, there should be 79309 tests run in the webkit_layout_tests step, and specifically, http/tests/cache/loaded-from-cache-after-reload.html should be there.

However, running query:

SELECT
  COUNT(*)
FROM
  `test-results-hrd.events.test_results`
WHERE
  build_id = '8942949908952105104'
  AND step_name = 'webkit_layout_tests (with patch)'
  AND path like '%http/tests/cache/loaded-from-cache-after-reload.html%'

Returns 0
 
Cc: jbudorick@chromium.org
Owner: liaoyuke@chromium.org
Status: Assigned (was: Untriaged)
Summary: Some of the webkit layout test results were uploaded to test-results table (was: Only half of the webkit layout test results were uploaded to test-results table)
Summary: Some of the webkit layout test results were missing from the test-results table (was: Some of the webkit layout test results were uploaded to test-results table)
Description: Show this description
Blocking: 837855
What's more, running:
SELECT
  COUNT(*)
FROM
  `test-results-hrd.events.test_results`
WHERE
  build_id = '8942949908952105104'
  AND step_name = 'webkit_layout_tests (with patch)'

Returns 11500, which doesn't match with the step description.
11500 is way less than 79309
Owner: seanmccullough@chromium.org
Assigning to Sean for investigation, thank you very much!
Labels: flake-detection

Sign in to add a comment