Issue 704394 link

Starred by 1 user

Issue metadata

Status:	Archived
Owner:	█ tansell@chromium.org Last visit > 30 days ago
Closed:	Jun 2018
Cc:	█ jparent@chromium.org █ mcgreevy@chromium.org iannu...@google.com
Components:	Infra>Platform>Recipes
EstimatedDays:	----
NextAction:	----
OS:	----
Pri:	2
Type:	Feature
Hotlist-Recharge-Cold

Blocked on:
issue 704387

Unify the buildbot output look & feel for all test runs

Project Member Reported by tansell@chromium.org, Mar 23 2017

Issue description

I recently deployed a change to make isolated tests + webkit layout tests produce the following text output. This makes it much clearer what tests ran, what is failing, etc.

We should make gtest and everything else also output the *same* text -- IE everything should look the same to the developer.

There are a couple of extra states which the current output doesn't handle. They are;
 * Number of disabled tests.
 * Number of skipped tests.
b
Also when https://bugs.chromium.org/p/chromium/issues/detail?id=704387 is fixed. This text output can be even more human friendly.

================================================

On success;
-------
Total tests: 6
* Passed: 1 (1 expected, 0 unexpected)
* Failed: 2 (2 expected, 0 unexpected)
* Flaky: 3 (3 expected, 0 unexpected)
-------


On the failure case;
-------
Total tests: 6
* Passed: 1 (1 expected, 0 unexpected)
* Failed: 2 (0 expected, >>>2 unexpected<<<)
* Flaky: 3 (3 expected, 0 unexpected)

Unexpected Failures:
* bad/totally-bad-probably.html
* tricky/totally-maybe-not-awesome.html
-------


It also trims if there are too many failures;
-------
Total tests: 131
* Passed: 1 (1 expected, 0 unexpected)
* Failed: 127 (0 expected, >>>127 unexpected<<<)
* Flaky: 3 (0 expected, >>>3 unexpected<<<)

Unexpected Failures:
* bad/failing0.html
<snip>
* bad/failing27.html
* bad/failing28.html
* bad/failing29.html
* ... 97 more ...

Unexpected Flakes:
* flake/slow.html
* flake/timeout-then-crash.html
* flake/totally-flakey.html
-------

I recently deployed a change to make isolated tests + webkit layout tests produce the following text output. This makes it much clearer what tests ran, what is failing, etc.

We should make gtest and everything else also output the *same* text -- IE everything should look the same to the developer.

There are a couple of extra states which the current output doesn't handle. They are;
 * Number of disabled tests.
 * Number of skipped tests.

Also when https://bugs.chromium.org/p/chromium/issues/detail?id=704387 is fixed. This text output can be even more human friendly.

================================================

On success;
-------
Total tests: 6
* Passed: 1 (1 expected, 0 unexpected)
* Failed: 2 (2 expected, 0 unexpected)
* Flaky: 3 (3 expected, 0 unexpected)
-------


On the failure case;
-------
Total tests: 6
* Passed: 1 (1 expected, 0 unexpected)
* Failed: 2 (0 expected, >>>2 unexpected<<<)
* Flaky: 3 (3 expected, 0 unexpected)

Unexpected Failures:
* bad/totally-bad-probably.html
* tricky/totally-maybe-not-awesome.html
-------


It also trims if there are too many failures;
-------
Total tests: 131
* Passed: 1 (1 expected, 0 unexpected)
* Failed: 127 (0 expected, >>>127 unexpected<<<)
* Flaky: 3 (0 expected, >>>3 unexpected<<<)

Unexpected Failures:
* bad/failing0.html
<snip>
* bad/failing27.html
* bad/failing28.html
* bad/failing29.html
* ... 97 more ...

Unexpected Flakes:
* flake/slow.html
* flake/timeout-then-crash.html
* flake/totally-flakey.html
-------

Comment 1 by jparent@chromium.org, Mar 23 2017

Anything you can do to unify the test runners is valuable in my mind.

Comment 2 by tansell@chromium.org, Mar 23 2017

Description: Show this description

Comment 3 by tansell@chromium.org, Mar 23 2017

I logged this bug so I come back to it after deploying layout tests on swarming.

Project Member

Comment 4 by bugdroid1@chromium.org, Mar 23 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/ac4da194a237c33a590c3518515c2ea148037f86

commit ac4da194a237c33a590c3518515c2ea148037f86
Author: Tim 'mithro' Ansell <tansell@chromium.org>
Date: Thu Mar 23 12:42:33 2017

chromium: Fixing the test results handler for skipped tests.

The previous code didn't deal with skipped tests. This lead to alarming
output like;
------
Total tests: 61245
* Passed: 51187 (51156 expected, 31 unexpected)
* Failed: 10020 (10020 expected, 0 unexpected)
------

Rather than;
------
Total tests: 61245
* Passed: 51187 (51156 expected, 31 unexpected)
* Skipped: 9091 (9081 expected, 0 unexpected)
* Failed: 939 (939 expected, 0 unexpected)
------

To prevent other unknown test results, the code explicitly lists all test
results it understands. Any unknown test results will be considered an
exception.

BUG= 524758 , 704394 

Change-Id: I751c0e500315e694e6fecf5b640edf3cf4bc44c3
Reviewed-on: https://chromium-review.googlesource.com/458242
Commit-Queue: Tim 'mithro' Ansell <tansell@chromium.org>
Reviewed-by: Paweł Hajdan Jr. <phajdan.jr@chromium.org>

[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_android_android_blink_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/webkit_tests_interrupted.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_win32_release.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_9_blink_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_10.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipe_modules/test_utils/test_api.py
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipe_modules/swarming/example.expected/isolated_script_expired_new.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_mac64_debug.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_fail.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/isolated_script_test_custom_merge_script_with_args.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipe_modules/swarming/example.expected/isolated_script_expired_old.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__pass.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_tsan2.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_win32_debug.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux_ubsan_vptr.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipe_modules/swarming/example.expected/isolated_large_outdir.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/isolated_script_test_custom_merge_script.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux32_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_pass.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_linux_trusty_blink_dbg.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_asan.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_linux_trusty_blink_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___ignition_pass.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/use_v8_patch_on_blink_trybot_test_failures.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___ignition_fail.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_win64_debug.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_ubsan_vptr.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_fyi_linux__swarming_.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_unexpected_error.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win7__dbg_.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_ASAN.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/blink_compile_without_patch_fails.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11__retina_.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win7_blink_dbg.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/chromium_webkit_revision_webkit.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty.json
[add] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_local_isolated_script_test_with_unknown_json_results.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/minimal_pass_continues.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11__dbg_.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/webkit_tests_unexpected_error.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux_memcheck.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_mac_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_x64_dbg.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_10_blink_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_12_blink_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Android__Nexus4_.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_12.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux32_release.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_11_blink_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_fail.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/blink_minimal_pass_continues.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux_tsan_v2.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty__dbg_.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_dbg.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipe_modules/swarming/example.expected/isolated_script_timeout_old.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_x64_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_mac_asan.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_9.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux_msan.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_interrupted.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/isolated_script_test_custom_results_handler.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_release.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Mac_fail.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Site_Isolation_Win.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__fail.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_corrupt_json_isolated_script_test.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_pass.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_with_and_without_patch_fail.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_mac_gpu.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux32_debug.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux_ubsan.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/chromium_webkit_parent_revision_webkit.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_mac_asan.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipe_modules/swarming/example.expected/isolated_script_timeout_new.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_ubsan.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux_slimming_paint_v2_Dummy_Builder.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_msan.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/too_many_failures_for_retcode.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Mac___RandomOrder.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux___RandomOrder.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipe_modules/chromium_tests/steps.py
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win10_blink_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_dbg.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_linux_gpu.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Win___RandomOrder.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Browser_Side_Navigation_Linux.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_failed_isolated_script_test.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_fyi_mac__swarming_.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/chromium_webkit_parent_revision_chromium.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/use_skia_patch_on_chromium_trybot.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/non_cq_blink_tryjob.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_debug_forced.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux32_dbg.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipe_modules/test_utils/util.py
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Win_fail.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_debug_failing_test.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_chromium_browser_side_navigation_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_site_isolation.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_debug.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_11_retina_blink_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_passed_isolated_script_test.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_local_isolated_script_test_with_passed_json_results.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win7.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_swarmed_passed_isolated_script_test.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_mac64_release.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_layout_tests_slimming_paint_v2.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win7_blink_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/use_v8_patch_on_chromium_trybot.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_9_blink_dbg.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Mac_pass.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/chromium_webkit_revision_chromium.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_win_non_gpu.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_v8_v8_linux_blink_rel.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_memcheck.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_fyi_win__swarming_.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux___TraceWrappables.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_MSAN.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_local_isolated_script_test_with_corrupt_json_results.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win10.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/too_many_failures_for_retcode.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_win64_release.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_local_isolated_script_test_with_failed_json_results.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_fyi_win32_asan__swarming_.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_mac_dbg.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/analyze_webkit.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium_trybot.expected/dont_analyze_for_non_src_project.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Site_Isolation_Linux.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.py
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux_asan.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_win_gpu.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/chromium_webkit_warnings.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Win_pass.json
[modify] https://crrev.com/ac4da194a237c33a590c3518515c2ea148037f86/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_Leak.json

Project Member

Comment 5 by bugdroid1@chromium.org, Mar 23 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/786366148079983fd99174150715b5b819d7a303

commit 786366148079983fd99174150715b5b819d7a303
Author: Tim 'mithro' Ansell <tansell@chromium.org>
Date: Thu Mar 23 12:50:33 2017

chromium: Process the full WebKit Layout Tests results.

This fixes the output counts for Layout Tests;
---------------------------------------
Total tests: 2160
* Passed: 1172 (1172 expected, 0 unexpected)
* Failed: 956 (956 expected, 0 unexpected)
* Flaky: 32 (32 expected, 0 unexpected)
---------------------------------------

Changes to;
---------------------------------------
Total tests: 61245
* Passed: 51187 (51156 expected, 31 unexpected)
* Failed: 10020 (10020 expected, 0 unexpected)
* Flaky: 38 (38 expected, 0 unexpected)
--------------------------------------- 

BUG= 524758 , 704394 

Change-Id: Id13dcc1172291d7d01af5d19e8f87ed3ac1cdd55
Reviewed-on: https://chromium-review.googlesource.com/458466
Commit-Queue: Tim 'mithro' Ansell <tansell@chromium.org>
Reviewed-by: Paweł Hajdan Jr. <phajdan.jr@chromium.org>

[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/non_cq_blink_tryjob.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win7_blink_dbg.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Mac_fail.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/webkit_tests_interrupted.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/chromium_webkit_revision_webkit.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_v8_v8_linux_blink_rel.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_9_blink_rel.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Win_fail.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Site_Isolation_Win.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/minimal_pass_continues.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__fail.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11__dbg_.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_chromium_browser_side_navigation_rel.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/webkit_tests_unexpected_error.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_fail.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_android_android_blink_rel.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_pass.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_linux_trusty_blink_rel.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_with_and_without_patch_fail.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win10_blink_rel.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_11_retina_blink_rel.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win7.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__pass.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_interrupted.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_9.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_layout_tests_slimming_paint_v2.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win7_blink_rel.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_10_blink_rel.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_12_blink_rel.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/use_v8_patch_on_chromium_trybot.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_9_blink_dbg.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Mac_pass.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/chromium_webkit_revision_chromium.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Android__Nexus4_.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty__dbg_.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_12.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux___TraceWrappables.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux_slimming_paint_v2_Dummy_Builder.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_10.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/chromium_webkit_crash.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_11_blink_rel.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_pass.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_MSAN.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_fail.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/too_many_failures_for_retcode.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/blink_minimal_pass_continues.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Mac___RandomOrder.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux___RandomOrder.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipe_modules/chromium_tests/steps.py
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win10.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/too_many_failures_for_retcode.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_linux_trusty_blink_dbg.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___ignition_pass.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/use_v8_patch_on_blink_trybot_test_failures.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Win___RandomOrder.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___ignition_fail.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/analyze_webkit.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Browser_Side_Navigation_Linux.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_unexpected_error.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/dont_analyze_for_non_src_project.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win7__dbg_.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Site_Isolation_Linux.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_ASAN.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/blink_compile_without_patch_fails.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11__retina_.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/chromium_webkit_parent_revision_chromium.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_site_isolation.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/chromium_webkit_warnings.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium_trybot.expected/use_skia_patch_on_chromium_trybot.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/chromium_webkit_parent_revision_webkit.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Win_pass.json
[modify] https://crrev.com/786366148079983fd99174150715b5b819d7a303/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_Leak.json

Project Member

Comment 6 by bugdroid1@chromium.org, Mar 23 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/8bcb947602f5586c890174bf48529761ec1e6289

commit 8bcb947602f5586c890174bf48529761ec1e6289
Author: Tim 'mithro' Ansell <tansell@chromium.org>
Date: Thu Mar 23 12:58:15 2017

chromium: Change WebKit Layout Tests results upload.

run-webkit-tests would previously upload tests results directly to the
test result server. Now the results are uploaded using the standard
recipes method for uploading.

This has numerous advantages;
 * Allows one location for refactoring the test result server
   processing.
 * Allows standard behaviour around retries and overriding the test
   result server.
 * Makes layout tests less of a special case.

BUG= 524758 , 704394 

Change-Id: I2e403dfeb5e02c32ac379fad61759bf31fb27c96
Reviewed-on: https://chromium-review.googlesource.com/458182
Commit-Queue: Tim 'mithro' Ansell <tansell@chromium.org>
Reviewed-by: Paweł Hajdan Jr. <phajdan.jr@chromium.org>

[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/non_cq_blink_tryjob.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win7_blink_dbg.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Mac_fail.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/webkit_tests_interrupted.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/chromium_webkit_revision_webkit.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_v8_v8_linux_blink_rel.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_9_blink_rel.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Win_fail.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Site_Isolation_Win.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/minimal_pass_continues.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__fail.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11__dbg_.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_chromium_browser_side_navigation_rel.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/webkit_tests_unexpected_error.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_fail.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_android_android_blink_rel.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_pass.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_linux_trusty_blink_rel.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_with_and_without_patch_fail.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win10_blink_rel.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_11_retina_blink_rel.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win7.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__pass.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_interrupted.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_9.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_layout_tests_slimming_paint_v2.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win7_blink_rel.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_10_blink_rel.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_12_blink_rel.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/use_v8_patch_on_chromium_trybot.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_9_blink_dbg.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Mac_pass.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/chromium_webkit_revision_chromium.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Android__Nexus4_.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty__dbg_.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_12.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux___TraceWrappables.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux_slimming_paint_v2_Dummy_Builder.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_10.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/chromium_webkit_crash.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_11_blink_rel.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_pass.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_MSAN.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_fail.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/too_many_failures_for_retcode.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/blink_minimal_pass_continues.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Mac___RandomOrder.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux___RandomOrder.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipe_modules/chromium_tests/steps.py
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win10.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/too_many_failures_for_retcode.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_linux_trusty_blink_dbg.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___ignition_pass.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/use_v8_patch_on_blink_trybot_test_failures.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Win___RandomOrder.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___ignition_fail.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/analyze_webkit.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Browser_Side_Navigation_Linux.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_unexpected_error.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/dont_analyze_for_non_src_project.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win7__dbg_.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Site_Isolation_Linux.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_ASAN.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/blink_compile_without_patch_fails.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11__retina_.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/chromium_webkit_parent_revision_chromium.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_site_isolation.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/chromium_webkit_warnings.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium_trybot.expected/use_skia_patch_on_chromium_trybot.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/chromium_webkit_parent_revision_webkit.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Win_pass.json
[modify] https://crrev.com/8bcb947602f5586c890174bf48529761ec1e6289/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_Leak.json

Project Member

Comment 7 by bugdroid1@chromium.org, Mar 23 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/072216afe61f9604972a1aceedabc34685053b6e

commit 072216afe61f9604972a1aceedabc34685053b6e
Author: Tim 'mithro' Ansell <tansell@chromium.org>
Date: Thu Mar 23 14:08:36 2017

Revert "chromium: Process the full WebKit Layout Tests results."

This reverts commit db4c25a76d7f08436725347dd5b2f48dbc5200c7.
https://chromium-review.googlesource.com/c/458466/6

BUG= 524758 , 704394 

Change-Id: I10df833b2c24d061fbd1b87bfd19006f26f4a727
Reviewed-on: https://chromium-review.googlesource.com/458139
Reviewed-by: Paweł Hajdan Jr. <phajdan.jr@chromium.org>
Commit-Queue: Tim 'mithro' Ansell <tansell@chromium.org>

[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/non_cq_blink_tryjob.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win7_blink_dbg.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Mac_fail.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/webkit_tests_interrupted.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/chromium_webkit_revision_webkit.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_v8_v8_linux_blink_rel.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_9_blink_rel.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Win_fail.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Site_Isolation_Win.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/minimal_pass_continues.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__fail.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11__dbg_.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_chromium_browser_side_navigation_rel.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/webkit_tests_unexpected_error.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_fail.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_android_android_blink_rel.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_pass.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_linux_trusty_blink_rel.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_with_and_without_patch_fail.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win10_blink_rel.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_11_retina_blink_rel.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win7.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__pass.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_interrupted.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_9.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_layout_tests_slimming_paint_v2.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win7_blink_rel.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_10_blink_rel.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_12_blink_rel.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/use_v8_patch_on_chromium_trybot.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_9_blink_dbg.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Mac_pass.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/chromium_webkit_revision_chromium.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Android__Nexus4_.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty__dbg_.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_12.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux___TraceWrappables.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux_slimming_paint_v2_Dummy_Builder.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_10.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/chromium_webkit_crash.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_11_blink_rel.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_pass.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_MSAN.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_fail.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/too_many_failures_for_retcode.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/blink_minimal_pass_continues.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Mac___RandomOrder.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux___RandomOrder.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipe_modules/chromium_tests/steps.py
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win10.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/too_many_failures_for_retcode.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_linux_trusty_blink_dbg.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___ignition_pass.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/use_v8_patch_on_blink_trybot_test_failures.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Win___RandomOrder.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___ignition_fail.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/analyze_webkit.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Browser_Side_Navigation_Linux.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_unexpected_error.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/dont_analyze_for_non_src_project.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win7__dbg_.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Site_Isolation_Linux.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_ASAN.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/blink_compile_without_patch_fails.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11__retina_.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/chromium_webkit_parent_revision_chromium.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_site_isolation.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/chromium_webkit_warnings.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium_trybot.expected/use_skia_patch_on_chromium_trybot.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/chromium_webkit_parent_revision_webkit.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Win_pass.json
[modify] https://crrev.com/072216afe61f9604972a1aceedabc34685053b6e/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_Leak.json

Project Member

Comment 8 by bugdroid1@chromium.org, Mar 24 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/b40d5bac94616d5df8e6317fd4c8919a0ec67e3b

commit b40d5bac94616d5df8e6317fd4c8919a0ec67e3b
Author: Tim 'mithro' Ansell <tansell@chromium.org>
Date: Fri Mar 24 02:04:51 2017

chromium: Make layout-test-wrapper produce the full results.

Also two big speed improvements;
 * Use .find rather than a regex to locate the JSON object.
 * Don't load the JSON object with json module for no reason.

This fixes the output counts for Layout Tests;
---------------------------------------
Total tests: 2160
* Passed: 1172 (1172 expected, 0 unexpected)
* Failed: 956 (956 expected, 0 unexpected)
* Flaky: 32 (32 expected, 0 unexpected)
---------------------------------------

Changes to;
---------------------------------------
Total tests: 61245
* Passed: 51187 (51156 expected, 31 unexpected)
* Failed: 10020 (10020 expected, 0 unexpected)
* Flaky: 38 (38 expected, 0 unexpected)
---------------------------------------

BUG= 524758 , 704394 

Change-Id: I80451a9637eedc4aea4b1e09852e71fc1ddb22b9
Reviewed-on: https://chromium-review.googlesource.com/457944
Commit-Queue: Tim 'mithro' Ansell <tansell@chromium.org>
Reviewed-by: Quinten Yearsley <qyearsley@chromium.org>

[modify] https://crrev.com/b40d5bac94616d5df8e6317fd4c8919a0ec67e3b/scripts/slave/chromium/layout_test_wrapper.py

Project Member

Comment 9 by bugdroid1@chromium.org, Apr 13 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/c035f184530b4a493f56a30f114e049e3d9c5cff

commit c035f184530b4a493f56a30f114e049e3d9c5cff
Author: tansell <tansell@chromium.org>
Date: Thu Apr 13 03:49:25 2017

webkitpy: Rework the JSON output flags.

This does the following;

 * Makes --write-full-results-to and --isolated-script-test-output
   aliases for --json-test-results.

 * Adds --json-failing-test-results in case anyone depends on only
   getting failing results.

 * Moves us towards removing needing
   testing/scripts/run_isolated_script_test.py to run layout tests on
   swarming (one less wrapper script layer, yay!).

 * This fixes the output counts on BuildBot for Layout Tests (when not
   run on swarming).

---------------------------------------
 Total tests: 2160
  * Passed: 1172 (1172 expected, 0 unexpected)
* Failed: 956 (956 expected, 0 unexpected)
* Flaky: 32 (32 expected, 0 unexpected)
---------------------------------------

   Changes to;
---------------------------------------
Total tests: 61245
* Passed: 51187 (51156 expected, 31 unexpected)
* Failed: 10020 (10020 expected, 0 unexpected)
* Flaky: 38 (38 expected, 0 unexpected)
---------------------------------------

BUG= 524758 , 704394 

Review-Url: https://codereview.chromium.org/2813173002
Cr-Commit-Position: refs/heads/master@{#464284}

[modify] https://crrev.com/c035f184530b4a493f56a30f114e049e3d9c5cff/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/controllers/manager.py
[modify] https://crrev.com/c035f184530b4a493f56a30f114e049e3d9c5cff/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py
[modify] https://crrev.com/c035f184530b4a493f56a30f114e049e3d9c5cff/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests_unittest.py

Comment 10 by iannucci@chromium.org, May 15 2017

Labels: Pri-2 Type-Feature
Status: Available (was: Untriaged)

Comment 11 by serg...@chromium.org, May 16 2017

Why was this unassigned from Tim? Wasn't this done already?

Comment 12 by tansell@chromium.org, Jun 7 2017

Owner: tansell@chromium.org

Project Member

Comment 13 by sheriffbot@chromium.org, Jun 7 2018

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)

This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Comment 14 by serg...@chromium.org, Jun 8 2018

Cc: -serg...@chromium.org

Comment 15 by no...@chromium.org, Jun 16 2018

Status: Archived (was: Untriaged)

reopen if relevant

►

Issue 704394 link

Issue metadata

Unify the buildbot output look & feel for all test runs

Issue description

Comment 1 by jparent@chromium.org, Mar 23 2017

Comment 1 Deleted

Comment 2 by tansell@chromium.org, Mar 23 2017

Comment 2 Deleted

Comment 3 by tansell@chromium.org, Mar 23 2017

Comment 3 Deleted

Comment 4 by bugdroid1@chromium.org, Mar 23 2017

Comment 4 Deleted

Comment 5 by bugdroid1@chromium.org, Mar 23 2017

Comment 5 Deleted

Comment 6 by bugdroid1@chromium.org, Mar 23 2017

Comment 6 Deleted

Comment 7 by bugdroid1@chromium.org, Mar 23 2017

Comment 7 Deleted

Comment 8 by bugdroid1@chromium.org, Mar 24 2017

Comment 8 Deleted

Comment 9 by bugdroid1@chromium.org, Apr 13 2017

Comment 9 Deleted

Comment 10 by iannucci@chromium.org, May 15 2017

Comment 10 Deleted

Comment 11 by serg...@chromium.org, May 16 2017

Comment 11 Deleted

Comment 12 by tansell@chromium.org, Jun 7 2017

Comment 12 Deleted

Comment 13 by sheriffbot@chromium.org, Jun 7 2018

Comment 13 Deleted

Comment 14 by serg...@chromium.org, Jun 8 2018

Comment 14 Deleted

Comment 15 by no...@chromium.org, Jun 16 2018

Comment 15 Deleted

Sign in to add a comment