So, the problem here is that validate_results attempts to figure out whether a test result was expected by comparing the test's "expected" result with its "actual" result. (see https://cs.chromium.org/chromium/build/scripts/slave/recipe_modules/chromium_tests/steps.py?l=814 )

However, this does not agree with the analysis that the TestResults class does: it checks for the presence of is_unexpected:true in the test result output. See
  https://cs.chromium.org/chromium/build/scripts/slave/recipe_modules/test_utils/util.py?l=47 .

It looks like whether or not a result is expected is not trivially decidable by inspecting the expected and actual output.  Instead, "is_unexpected" is calculated here:
  https://cs.chromium.org/chromium/src/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/models/test_run_results.py?rcl=cadf4232009c7877216ff5485244c263193ac4f5&l=287
which calls this:
  https://cs.chromium.org/chromium/src/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/models/test_expectations.py?rcl=6a787e3a33d497008aab7661b3adab4fc4feed7b&l=1087


Now, the problem is that the JSONResultsHandler is used by a bunch of different types of tests, and it's unclear to me which ones use is_unexpected (it's optional, per: https://www.chromium.org/developers/the-json-test-results-format).  So, I can't just rely on is_unexpected to indicate whether a result is expected, as some test types may not set it at all. From a quick code search, it looks like those tests which do use it set it only if the value is true, so we can't detect whether it's in use by checking for its presence.

Hmm. We should certainly have a deterministic way of being able to tell whether the results are expected or not. The layout tests logic is (as you've seen) decidedly more complicated than your average test case, which really generally doesn't have anything other than expected="PASS" anyway.

Perhaps the best backwards-compatible way to fix this would be to change the layout tests to always set is_unexpected, and update the spec to say that determining whether a test result is unexpected is:

if "is_unexpected" in result.keys():
  is_unexpected = result["is_unexpected"]
else:
  is_unexpected = <the logic in steps.py>

but I'm open to other approaches ...

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/30584dea7ace8de1ac915cb186ca68b99e176cf9

commit 30584dea7ace8de1ac915cb186ca68b99e176cf9
Author: Tim 'mithro' Ansell <tansell@chromium.org>
Date: Thu Mar 23 02:19:09 2017

chromium: Fixing the results handler for LayoutTests.

Make the output in the step better, it now looks like the following
on success;
-------
Total tests: 6
* Passed: 1 (1 expected, 0 unexpected)
* Failed: 2 (2 expected, 0 unexpected)
* Flaky: 3 (3 expected, 0 unexpected)
-------


On the failure case;
-------
Total tests: 6
* Passed: 1 (1 expected, 0 unexpected)
* Failed: 2 (0 expected, >>>2 unexpected<<<)
* Flaky: 3 (3 expected, 0 unexpected)

Unexpected Failures:
* bad/totally-bad-probably.html
* tricky/totally-maybe-not-awesome.html
-------


It also trims if there are too many failures;
-------
Total tests: 131
* Passed: 1 (1 expected, 0 unexpected)
* Failed: 127 (0 expected, >>>127 unexpected<<<)
* Flaky: 3 (0 expected, >>>3 unexpected<<<)

Unexpected Failures:
* bad/failing0.html
<snip>
* bad/failing27.html
* bad/failing28.html
* bad/failing29.html
* ... 97 more ...

Unexpected Flakes:
* flake/slow.html
* flake/timeout-then-crash.html
* flake/totally-flakey.html
-------

BUG= 524758 , 703500 

Change-Id: I4d0dcaee481caade0e41c6257e442b70c91ea763
Reviewed-on: https://chromium-review.googlesource.com/456448
Reviewed-by: Dirk Pranke <dpranke@chromium.org>
Reviewed-by: Sergiy Byelozyorov <sergiyb@google.com>
Reviewed-by: Michael McGreevy <mcgreevy@chromium.org>
Commit-Queue: Tim 'mithro' Ansell <tansell@chromium.org>

[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/android_arm.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/win32_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_android_android_blink_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/webkit_tests_interrupted.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_win32_release.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_9_blink_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipe_modules/chromium_tests/steps.py
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_10.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipe_modules/test_utils/test_api.py
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_mac64_debug.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_fail.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_mac64_release.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/isolated_script_test_custom_merge_script_with_args.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__pass.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_tsan2.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_win32_debug.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux_ubsan_vptr.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_win64_release.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_passed_isolated_script_perf_test_disabled.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/failed_ssl_tests.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_passed_isolated_script_perf_test_empty.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/isolated_script_test_custom_merge_script.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_isolated_chartjson_test_harness_failure.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_pass.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_linux_trusty_blink_dbg.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_release.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/linux_small.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_asan.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_linux_trusty_blink_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/linux_noasm_asan.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/linux_nothreads.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___ignition_pass.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_passed_isolated_script_perf_test.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/use_v8_patch_on_blink_trybot_test_failures.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_passed_with_bad_retcode_isolated_script_test.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___ignition_fail.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_win64_debug.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_isolated_chartjson_test_missing_shard.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_ubsan_vptr.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_fyi_linux__swarming_.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_unexpected_error.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win7__dbg_.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_ASAN.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/blink_compile_without_patch_fails.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11__retina_.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/win64_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win7_blink_dbg.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_isolated_chartjson_test_missing_all_shards.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/chromium_webkit_revision_webkit.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/android_aarch64.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/minimal_pass_continues.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11__dbg_.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/webkit_tests_unexpected_error.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux_memcheck.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_isolated_script_test_harness_failure_no_json.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_mac_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_x64_dbg.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.py
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_10_blink_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_12_blink_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/linux_clang_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Android__Nexus4_.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_failed_isolated_script_test.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_12.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/chromium_webkit_crash.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_11_blink_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_fail.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/blink_minimal_pass_continues.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux_tsan_v2.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty_MSAN.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/failed_unit_tests.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Linux_Trusty__dbg_.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_dbg.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/win32_small.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_x64_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_11.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_mac_asan.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Mac10_9.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/win64_small.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux_msan.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_interrupted.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/isolated_script_test_custom_results_handler.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_webkit_WebKit_Win7.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Mac_fail.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Site_Isolation_Win.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__fail.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_isolated_script_test.json
[rename] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_corrupt_json_isolated_script_test.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_pass.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/webkit_tests_with_and_without_patch_fail.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_mac_gpu.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux32_debug.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux_ubsan.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/chromium_webkit_parent_revision_webkit.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_mac_asan.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/android_arm_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_ubsan.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux_slimming_paint_v2_Dummy_Builder.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_msan.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_isolated_script_test_harness_failure_zero_retcode.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/too_many_failures_for_retcode.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_passed_isolated_script_test.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Linux___RandomOrder.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/android_aarch64_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win10_blink_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_dbg.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_linux_gpu.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux32_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/dynamic_isolated_script_test_with_args_on_trybot.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_fyi_WebKit_Win___RandomOrder.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/linux32.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Browser_Side_Navigation_Linux.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/linux_shared.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_failed_isolated_script_test.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_fyi_mac__swarming_.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/chromium_webkit_parent_revision_chromium.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/use_skia_patch_on_chromium_trybot.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/non_cq_blink_tryjob.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_debug_forced.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux32_dbg.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipe_modules/test_utils/util.py
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/linux_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Win_fail.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_debug_failing_test.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_chromium_browser_side_navigation_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/linux_nothreads_small.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/win32.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/mac_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/linux.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_site_isolation.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux32_release.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_debug.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_11_retina_blink_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_local_isolated_script_test_with_passed_json_results.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/linux32_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_passed_isolated_script_test.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/mac_small.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.py
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_chromium_linux_linux_layout_tests_slimming_paint_v2.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_win7_blink_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_passed_isolated_script_test_with_swarming_failure.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/use_v8_patch_on_chromium_trybot.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_blink_mac10_9_blink_dbg.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Mac_pass.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/chromium_webkit_revision_chromium.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_win_non_gpu.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/chromium_trybot.expected/full_tryserver_v8_v8_linux_blink_rel.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/boringssl.expected/win64.json
[modify] https://crrev.com/30584dea7ace8de1ac915cb186ca68b99e176cf9/scripts/slave/recipes/webrtc/standalone.exp

Not sure what the status of this is, but this looks like Client>Chrome rather than something that needs to change in the recipes platform as a whole.