Not sure when it started, probably some time over the Christmas holidays. All shards are failing with shard #XX had an internal swarming failure The logs indicate that the test command was successfully though. https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/linux-blink-heap-unified-gc
https://logs.chromium.org/logs/chromium/buildbucket/cr-buildbucket.appspot.com/8925222839751593952/+/steps/webkit_layout_tests/0/logs/swarming.summary/0 shows that it somehow doesn't know about the swarming shards that completed. That means that the logic in https://cs.chromium.org/chromium/build/scripts/slave/recipe_modules/swarming/api.py?q=swarming/api.py&sq=package:chromium&dr&l=1319 gets triggered, which is why these error messages are shown. I think this is related to the migration to the go swarming client in https://crbug.com/894045. tikuta@, is this related to your work? If not, feel free to unassign.
It seems come from difference between go and python client. I will take a look whether there is file handle leak in go client. But I wonder why the builder has too many open files error while other builders do not.
Any news here? This is rather important as the feature is getting closer to being launched and we need to make sure no correctness issue sneaks in.
I made https://chromium-review.googlesource.com/c/chromium/tools/build/+/1395713
Thanks!
The following revision refers to this bug: https://chromium.googlesource.com/chromium/tools/build/+/144fe563d8b88a7eb8b765e19eb9ef8274d2f625 commit 144fe563d8b88a7eb8b765e19eb9ef8274d2f625 Author: Takuto Ikuta <tikuta@chromium.org> Date: Mon Jan 07 18:23:46 2019 [swarming] reduce the number of network workers This is to reduce the too many open files error in 919079. Also I want to see whether this helps to mitigate 915332. Bug: 919079 , 915332 Recipe-Nontrivial-Roll: build_limited_scripts_slave Change-Id: I5d3c9d95d692aef5c64b984b1115808d2c901611 Reviewed-on: https://chromium-review.googlesource.com/c/1395713 Commit-Queue: Stephen Martinis <martiniss@chromium.org> Reviewed-by: Stephen Martinis <martiniss@chromium.org> Auto-Submit: Takuto Ikuta <tikuta@chromium.org> [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_linux_ubsan.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_gtest_mac_gpu.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_win64_release.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_linux64_debug_failing_test.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_android64__m_nexus5x_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_mac_asan.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_linux32_debug.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_mac_asan.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/isolated_script_test_custom_merge_script_with_args.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_linux_ubsan.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_linux_x86_dbg.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_mac_experimental.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_win32_release.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_perf_perf_android64__l_nexus9_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_android32__m_nexus5x__failing_archive.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_perf_win7.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/isolated_script_test_custom_merge_script.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_isolated_chartjson_test_harness_failure.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium_trybot.expected/dynamic_swarmed_isolated_script_test_failure_no_result_json.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium_trybot.expected/swarmed_webkit_tests_interrupted.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_branches_mac__beta_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_passed_with_bad_retcode_isolated_script_test.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_perf_perf_linux_trusty.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_perf_perf_android32__l_nexus5_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_linux_x86_rel.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_experimental.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_linux_msan.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium_trybot.expected/swarming_test_failure.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_branches_win__beta_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_x64_msvc_dbg.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_isolated_chartjson_test_missing_all_shards.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_android_arm_dbg.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/more_configs.expected/luci_webrtc_ci_win__more_configs_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipe_modules/swarming/api.py [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_linux64_debug_forced.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_x64_clang_dbg.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_linux_msan.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_win64_debug.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_x86_clang_dbg.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_perf_perf_android32__k_nexus5_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_perf_perf_android64__n_pixel_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_linux64_release.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_x64_msvc_rel.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_android_experimental.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_failed_isolated_script_test.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_x64_clang_rel.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/more_configs.expected/luci_webrtc_try_win_x86_more_configs.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_x86_msvc_rel.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium_trybot.expected/dynamic_isolated_script_test_with_args_on_trybot.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_x86_clang_rel.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_linux_memcheck.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipe_modules/swarming/examples/full.expected/isolated_script_non_zero_exit_status.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_perf_linux_trusty.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_branches_mac__stable_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_win32_debug.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_mac_rel.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_branches_linux__beta_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_perf_perf_android32__l_nexus6_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_mac64_debug.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/more_configs.expected/luci_webrtc_ci_linux__more_configs_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_perf_perf_android32__l_nexus4_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium_trybot.expected/dynamic_isolated_script_test_on_trybot_passing.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_isolated_chartjson_test_missing_shard.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_corrupt_json_isolated_script_test.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_android32__m_nexus5x__dbg_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_linux_asan.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_mac_gpu.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_asan.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_perf_mac_10_11.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_perf_perf_win7.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium_trybot.expected/dynamic_isolated_script_test_on_trybot_failing.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_linux_rel.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_x64_clang_dbg_win10.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_linux_asan.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_linux64_debug.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/gtest_custom_merge_script.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_passed_isolated_script_test.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_linux_gpu.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium_trybot.expected/swarmed_layout_tests_too_many_failures_for_retcode.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_win32_release__clang_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_mac_dbg.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_x64_clang_dbg_win8.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_failed_isolated_script_test.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_android32__m_nexus5x_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_android_arm64_rel.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_linux_ubsan_vptr.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_linux_tsan2.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_perf_perf_android32__n_nexus6_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium_trybot.expected/swarming_test_failure_no_patch_deapplication.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/more_configs.expected/luci_webrtc_try_linux_more_configs.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium_trybot.expected/swarming_test_with_priority_expiration_and_timeout.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_branches_linux__stable_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_android_arm64_dbg.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_branches_win__stable_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_win32_asan.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_android64__m_nexus5x__dbg_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_passed_isolated_script_test.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_android_arm_rel.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_passed_isolated_script_test_with_swarming_failure.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_win_non_gpu.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_failure_no_result_json.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_perf_perf_mac_10_11.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_win_x86_msvc_dbg.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_serialized_gtests.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_isolated_chartjson_test_disabled.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_linux_dbg.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_isolated_script_test_harness_failure.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_invalid_json_isolated_script_test.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_perf_perf_android32__l_nexus7_2_.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_try_linux_ubsan_vptr.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium_trybot.expected/swarmed_webkit_tests_unexpected_error.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_mac64_release.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_sharded_isolated_script_test_missing_shard.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/isolated_script_test_custom_results_handler.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/chromium.expected/dynamic_swarmed_isolated_script_test_win_gpu.json [modify] https://crrev.com/144fe563d8b88a7eb8b765e19eb9ef8274d2f625/scripts/slave/recipes/webrtc/standalone.expected/luci_webrtc_ci_linux_tsan_v2.json
Seems fixed.
Comment 1 by martiniss@chromium.org
, Jan 4Status: Assigned (was: Untriaged)