New issue
Advanced search Search tips

Issue 822103 link

Starred by 3 users

Issue metadata

Status: Fixed
Merged: issue 822042
Owner:
Closed: May 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug

Blocked on:
issue 822042
issue 804711
issue 821709

Blocking:
issue 776430



Sign in to add a comment

flakiness caused by sending Goma events to BQ.

Project Member Reported by yyanagisawa@chromium.org, Mar 15 2018

Issue description

Upload of update to upload_goma_logs.py due to crbug.com/776430, there seems to be several flaky behaviors, however, there seems to be several causes.
Let me set meta issues of all.

ImportError: No module named google.cloud
- switch annotated_run to remote_run
  https://bugs.chromium.org/p/chromium/issues/detail?id=821689
- "ImportError: No module named google.cloud"
  https://bugs.chromium.org/p/chromium/issues/detail?id=822042


ImportError: No module named slave
- Refactoring entry points of upload_goma_logs.py
  https://bugs.chromium.org/p/chromium/issues/detail?id=804711
 
Blockedon: 804711 821689 821709 822042
Blocking: 776430
note that discussion is going on in:
https://bugs.chromium.org/p/chromium/issues/detail?id=821689

Mergedinto: 822042
Status: Duplicate (was: Untriaged)
Status: Untriaged (was: Duplicate)
Missed that this is a meta bug.
Blockedon: -821689
 Issue 821689  is a red herring. I've converted bots to remote_run, but it's still happening on them.
Project Member

Comment 6 by bugdroid1@chromium.org, Mar 15 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/a4935e24022a8bba02259dab526e6f2e49bebb53

commit a4935e24022a8bba02259dab526e6f2e49bebb53
Author: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Date: Thu Mar 15 09:01:16 2018

api.build.python won't run runit.py with vpython.

tl;dr if venv=True,
* before this cl:
runit.py: vpython
upload_goma_logs.py: vpython
* after this cl:
runit.py: platform python
upload_goma_logs.py: vpython

Running vpython inside vpython could be a cause of  crbug.com/821689 .
Let me make runit.py not invoked by vpython but make runit.py to
invoke others with vpython if venv=True.

Current behavior is like:
If venv=True, runit.py is invoked with vpython without
--with-third-party-libs flag, and runit.py invokes child process
with vpython if the flag is not given.

I do not think runit.py use libraries that need to be executed
with vpython, and make runit.py executed with platform python instead
of vpython to avoid running vpython inside vpython.

Bug:  822103 
Change-Id: Ic1bb526be6ef7aa338de0bf35d818734640355b8
Recipe-Nontrivial-Roll: infra
Recipe-Nontrivial-Roll: build_limited_scripts_slave
Recipe-Nontrivial-Roll: release_scripts
Reviewed-on: https://chromium-review.googlesource.com/963953
Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org>

[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_Android_deterministic__dbg_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_x64_win10.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/test.expected/flaky_tests.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/test.expected/remove_culprits_for_flaky_failures.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/syzygy/continuous.expected/full_master_client_syzygy_win_x64_dbg_try.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_win32_release__clang_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_mac64_debug.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/wasm_llvm.expected/linux.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux64_debug.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium_tests/tests/api/compile_specific_targets.expected/failure_tryserver.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/goma/examples/full.expected/win_goma_canary.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_baremetal.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_compile_x64_dbg.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/pdfium.expected/win_no_v8.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/dart/examples/example.expected/basic-missing-name.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_Linux_deterministic__dbg_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/dart/examples/example.expected/basic-timeout.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/cronet.expected/android_cronet_builder__dbg_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/android/builder.expected/full_chromium_perf_Android_Builder.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/cronet.expected/local_test.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_android_experimental.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium.chromedriver.recipe_autogen.expected/Linux.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_perf_mac_10_11.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/goma/examples/full.expected/win.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/pdfium.expected/win_xfa_asan.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium_tests/tests/api/compile_specific_targets.expected/linux_tests.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_trybot.expected/swarmed_webkit_tests_interrupted.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/dart/sdk_swarming.expected/dart-sdk-linux-be.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium.chromedriver.recipe_autogen.expected/Linux32.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium.expected/build_dynamic_swarmed_isolated_script_test_compile_target_overidden.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/dart/vm_kernel_swarming.expected/vm-kernel-mac-release-x64-be.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/android/builder.expected/full_client_v8_fyi_Android_Builder.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_branches_win__beta_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_pgo.expected/full_chromium_fyi_Chromium_Win_PGO_Builder.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium_tests/tests/steps/swarming_isolated_script_test.expected/histograms.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/compile.expected/find_culprit_in_middle_of_a_sub_range.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_ios_arm64_release.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_android64__m_nexus5x_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_android_compile_rel.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_Android_deterministic_fail.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/dart/examples/example.expected/analyzer-linux-release-be.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium/tests/sizes.expected/platform.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_android32__m_nexus5x_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_codesearch.expected/full_codesearch_gen_chromium_linux.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/flake.expected/flakiness_isolate_only.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_win32_release__large_tests_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/swarming/staging.expected/one_fails.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/cronet.expected/cronet_try.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/flake.expected/flakiness_swarming_tests.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_debug__arm_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/syzygy/coverage.expected/full_master_client_syzygy_win_cov_try.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_win_rel.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_trybot.expected/dynamic_isolated_script_test_with_args_on_trybot.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/cronet/examples/full.expected/gn_test.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_perf_linux_trusty.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/compile.expected/compile_specified_targets_from_parameter.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/dart/examples/example.expected/basic-failure.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_android_x64.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_win64_release.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium/tests/compile.expected/official.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_release__gcc_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_trybot.expected/invalid_results.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/cronet.expected/android_cronet_marshmallow_64bit_perf.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/compile.expected/failed_compile_upon_infra_failure_goma_build_error.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_Mac_deterministic.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/pdfium.expected/mac_xfa_rel.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_android32__m_nexus5x__failing_archive.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_libfuzzer.expected/full_chromium_fyi_Libfuzzer_Upload_Linux_MSan.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_libfuzzer.expected/full_chromium_fyi_Libfuzzer_Upload_Mac_ASan.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_pass.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_libfuzzer.expected/full_chromium_fyi_Libfuzzer_Upload_Linux_UBSan.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_win_clang.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux32_debug.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium/tests/compile.expected/goma_custom_jobs.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux_ubsan.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_mac_asan.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/test.expected/findit_culprit_in_last_sub_range.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_trybot.expected/dont_deapply_patch.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/cronet.expected/android_cronet_kitkat_builder.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/ios/try.expected/gn.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium_tests/tests/steps/swarming_isolated_script_test.expected/chartjson_ignore_task_failure.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux64_debug_forced.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_ios_release.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_msan.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/syzygy/examples/full.expected/full_master_client_syzygy_Syzygy_Debug.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/pdfium.expected/linux.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_win_x64_clang_rel.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_gn_upload.expected/full_luci_infra_internal_prod_gn_builder_linux.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/pdfium.expected/linux_asan_lsan.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/test.expected/record_infra_failure.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/syzygy/continuous.expected/full_master_client_syzygy_win_official_try.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/flake.expected/record_infra_failure.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/pdfium.expected/linux_xfa_jumbo.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_pgo.expected/full_tryserver_chromium_win_win_pgo_x64.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_linux_ubsan.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/goma/examples/full.expected/mac.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_release.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/pdfium.expected/mac_xfa_jumbo.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_linux_tsan2.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux_tsan_v2.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium.expected/dynamic_instrumentation_test.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/test.expected/findit_tests_multiple_culprits.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/ios_api_framework.expected/trybot_build.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/flake.expected/use_build_parameter_for_tests.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_trybot.expected/compile_because_of_analyze_with_filtered_compile_targets.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/dart/examples/example.expected/basic-win-stable.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium_tests/tests/steps/swarming_isolated_script_test.expected/chartjson_simplified_ignore_task_failure.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium.chromedriver.recipe_autogen.expected/Mac_10_6.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium/examples/full.expected/basic_out_dir_with_custom_mb_config.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_android_compile_x64_dbg.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/compile.expected/compile_specified_targets.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_x64_clang_dbg.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium/tests/compile.expected/codesearch.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/test.expected/findit_steps_multiple_culprits.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/pdfium.expected/android.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium_tests/tests/api/trybot_steps.expected/basic.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux32_debug__arm_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium.expected/dynamic_gtest_memory_builder.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/findit/chromium/compile.expected/find_culprit_at_first_revision_of_a_sub_range.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_arm64_rel.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_win32_debug__clang_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_win64_debug__clang_.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_trybot.expected/compile_failure_infra.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_compile_rel.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_android64_x64_debug.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/goma/examples/full.expected/linux_compile_failed.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/cronet.expected/android_cronet_lollipop_builder.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux32_arm_dbg.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/pdfium.expected/linux_xfa_rel.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux_asan.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_ios.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_win32_debug.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_android_compile_arm64_dbg.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_fail.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_android_release.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium.expected/dynamic_instrumentation_test_custom_name.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_Deterministic_Linux.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__pass.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/client.nacl.sdk.recipe_autogen.expected/linux_sdk_asan_multi.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_linux_chromium_clobber_deterministic_fail.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_mac64_release.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_trybot.expected/compile_failure_without_patch_ng.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux32_debug.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_codesearch.expected/full_codesearch_gen_chromium_android.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/chromium_android/examples/full.expected/restart_usb_builder_basic.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux32_rel.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_pass.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/pdfium.expected/linux_xfa.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/ios/try.expected/goma_compilation_failure.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipe_modules/dart/examples/example.expected/basic-win.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_asan.json
[modify] https://crrev.com/a4935e24022a8bba02259dab526e6f2e49bebb53/scripts/slave/recipes/chromium_trybot.expected/dynamic_swarmed_isolated
Project Member

Comment 7 by bugdroid1@chromium.org, Mar 15 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10

commit b81b2455324cf5b02c4cffc89cf1fc30c02c0b10
Author: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Date: Thu Mar 15 09:24:28 2018

Revert "api.build.python won't run runit.py with vpython."

This reverts commit a4935e24022a8bba02259dab526e6f2e49bebb53.

Reason for revert:
Traceback (most recent call last):
  File "/b/rr/tmpSYKlzT/rw/checkout/scripts/slave/upload_goma_logs.py", line 16, in <module>
    from slave import goma_bq_utils
ImportError: No module named slave
To lots of builders, sigh.

Original change's description:
> api.build.python won't run runit.py with vpython.
> 
> tl;dr if venv=True,
> * before this cl:
> runit.py: vpython
> upload_goma_logs.py: vpython
> * after this cl:
> runit.py: platform python
> upload_goma_logs.py: vpython
> 
> Running vpython inside vpython could be a cause of  crbug.com/821689 .
> Let me make runit.py not invoked by vpython but make runit.py to
> invoke others with vpython if venv=True.
> 
> Current behavior is like:
> If venv=True, runit.py is invoked with vpython without
> --with-third-party-libs flag, and runit.py invokes child process
> with vpython if the flag is not given.
> 
> I do not think runit.py use libraries that need to be executed
> with vpython, and make runit.py executed with platform python instead
> of vpython to avoid running vpython inside vpython.
> 
> Bug:  822103 
> Change-Id: Ic1bb526be6ef7aa338de0bf35d818734640355b8
> Recipe-Nontrivial-Roll: infra
> Recipe-Nontrivial-Roll: build_limited_scripts_slave
> Recipe-Nontrivial-Roll: release_scripts
> Reviewed-on: https://chromium-review.googlesource.com/963953
> Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
> Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org>

TBR=iannucci@chromium.org,yyanagisawa@chromium.org,machenbach@chromium.org,sergiyb@chromium.org

Change-Id: I763f82e7c4a871b57be9152970867d3ca3ff63cc
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Bug:  822103 
Reviewed-on: https://chromium-review.googlesource.com/963882
Reviewed-by: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>

[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_Android_deterministic__dbg_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_x64_win10.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/test.expected/flaky_tests.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/test.expected/remove_culprits_for_flaky_failures.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/syzygy/continuous.expected/full_master_client_syzygy_win_x64_dbg_try.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_win32_release__clang_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_mac64_debug.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/wasm_llvm.expected/linux.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux64_debug.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium_tests/tests/api/compile_specific_targets.expected/failure_tryserver.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/goma/examples/full.expected/win_goma_canary.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_baremetal.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_compile_x64_dbg.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/pdfium.expected/win_no_v8.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/dart/examples/example.expected/basic-missing-name.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_Linux_deterministic__dbg_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/dart/examples/example.expected/basic-timeout.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/cronet.expected/android_cronet_builder__dbg_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/android/builder.expected/full_chromium_perf_Android_Builder.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/cronet.expected/local_test.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_android_experimental.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium.chromedriver.recipe_autogen.expected/Linux.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_perf_mac_10_11.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/goma/examples/full.expected/win.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/pdfium.expected/win_xfa_asan.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium_tests/tests/api/compile_specific_targets.expected/linux_tests.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_trybot.expected/swarmed_webkit_tests_interrupted.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/dart/sdk_swarming.expected/dart-sdk-linux-be.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium.chromedriver.recipe_autogen.expected/Linux32.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium.expected/build_dynamic_swarmed_isolated_script_test_compile_target_overidden.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/dart/vm_kernel_swarming.expected/vm-kernel-mac-release-x64-be.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/android/builder.expected/full_client_v8_fyi_Android_Builder.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_branches_win__beta_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_pgo.expected/full_chromium_fyi_Chromium_Win_PGO_Builder.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium_tests/tests/steps/swarming_isolated_script_test.expected/histograms.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/compile.expected/find_culprit_in_middle_of_a_sub_range.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_ios_arm64_release.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_android64__m_nexus5x_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_android_compile_rel.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_Android_deterministic_fail.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/dart/examples/example.expected/analyzer-linux-release-be.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium/tests/sizes.expected/platform.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_android32__m_nexus5x_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_codesearch.expected/full_codesearch_gen_chromium_linux.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/flake.expected/flakiness_isolate_only.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_win32_release__large_tests_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/swarming/staging.expected/one_fails.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/cronet.expected/cronet_try.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/flake.expected/flakiness_swarming_tests.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_debug__arm_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/syzygy/coverage.expected/full_master_client_syzygy_win_cov_try.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_win_rel.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_trybot.expected/dynamic_isolated_script_test_with_args_on_trybot.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/cronet/examples/full.expected/gn_test.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_perf_linux_trusty.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/compile.expected/compile_specified_targets_from_parameter.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/dart/examples/example.expected/basic-failure.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_android_x64.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_win64_release.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium/tests/compile.expected/official.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_release__gcc_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_trybot.expected/invalid_results.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/cronet.expected/android_cronet_marshmallow_64bit_perf.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/compile.expected/failed_compile_upon_infra_failure_goma_build_error.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_Mac_deterministic.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/pdfium.expected/mac_xfa_rel.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_android32__m_nexus5x__failing_archive.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_libfuzzer.expected/full_chromium_fyi_Libfuzzer_Upload_Linux_MSan.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_libfuzzer.expected/full_chromium_fyi_Libfuzzer_Upload_Mac_ASan.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64___future_pass.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_libfuzzer.expected/full_chromium_fyi_Libfuzzer_Upload_Linux_UBSan.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_win_clang.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux32_debug.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium/tests/compile.expected/goma_custom_jobs.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux_ubsan.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_mac_asan.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/test.expected/findit_culprit_in_last_sub_range.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_trybot.expected/dont_deapply_patch.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/cronet.expected/android_cronet_kitkat_builder.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/ios/try.expected/gn.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium_tests/tests/steps/swarming_isolated_script_test.expected/chartjson_ignore_task_failure.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux64_debug_forced.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_ios_release.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_msan.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/syzygy/examples/full.expected/full_master_client_syzygy_Syzygy_Debug.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/pdfium.expected/linux.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_win_x64_clang_rel.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_gn_upload.expected/full_luci_infra_internal_prod_gn_builder_linux.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/pdfium.expected/linux_asan_lsan.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/test.expected/record_infra_failure.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/syzygy/continuous.expected/full_master_client_syzygy_win_official_try.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/flake.expected/record_infra_failure.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/pdfium.expected/linux_xfa_jumbo.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_pgo.expected/full_tryserver_chromium_win_win_pgo_x64.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_linux_ubsan.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/goma/examples/full.expected/mac.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux64_release.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/pdfium.expected/mac_xfa_jumbo.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_linux_tsan2.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux_tsan_v2.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium.expected/dynamic_instrumentation_test.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/test.expected/findit_tests_multiple_culprits.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/ios_api_framework.expected/trybot_build.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/flake.expected/use_build_parameter_for_tests.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_trybot.expected/compile_because_of_analyze_with_filtered_compile_targets.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/dart/examples/example.expected/basic-win-stable.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium_tests/tests/steps/swarming_isolated_script_test.expected/chartjson_simplified_ignore_task_failure.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium.chromedriver.recipe_autogen.expected/Mac_10_6.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium/examples/full.expected/basic_out_dir_with_custom_mb_config.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_android_compile_x64_dbg.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/compile.expected/compile_specified_targets.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_x64_clang_dbg.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium/tests/compile.expected/codesearch.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/test.expected/findit_steps_multiple_culprits.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/pdfium.expected/android.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium_tests/tests/api/trybot_steps.expected/basic.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/client_webrtc_linux32_debug__arm_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium.expected/dynamic_gtest_memory_builder.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/findit/chromium/compile.expected/find_culprit_at_first_revision_of_a_sub_range.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux_arm64_rel.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_win32_debug__clang_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_win64_debug__clang_.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_trybot.expected/compile_failure_infra.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_win_compile_rel.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_android64_x64_debug.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/goma/examples/full.expected/linux_compile_failed.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/cronet.expected/android_cronet_lollipop_builder.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux32_arm_dbg.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/pdfium.expected/linux_xfa_rel.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux_asan.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/tryserver_libyuv_ios.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_win32_debug.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_android_compile_arm64_dbg.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64_fail.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_android_release.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium.expected/dynamic_instrumentation_test_custom_name.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_Deterministic_Linux.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/blink_downstream.expected/full_client_v8_fyi_V8_Blink_Linux_64__dbg__pass.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/client.nacl.sdk.recipe_autogen.expected/linux_sdk_asan_multi.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/swarming/deterministic_build.expected/full_chromium_swarm_linux_chromium_clobber_deterministic_fail.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_mac64_release.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_trybot.expected/compile_failure_without_patch_ng.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/libyuv/libyuv.expected/client_libyuv_linux32_debug.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/chromium_codesearch.expected/full_codesearch_gen_chromium_android.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipe_modules/chromium_android/examples/full.expected/restart_usb_builder_basic.json
[modify] https://crrev.com/b81b2455324cf5b02c4cffc89cf1fc30c02c0b10/scripts/slave/recipes/webrtc/standalone.expected/tryserver_webrtc_linux32_
Labels: -Pri-2 Pri-1
This is breaking tons of WebRTC builds. This is borderline P0 now. Can't you revert something to get back into a working state here?
Project Member

Comment 9 by bugdroid1@chromium.org, Mar 16 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/fd888d31f47f99cd6b933c9c2ce026f91f800ea2

commit fd888d31f47f99cd6b933c9c2ce026f91f800ea2
Author: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Date: Fri Mar 16 07:16:26 2018

Workaround: load BQ-related modules only if they are needed.

BigQuery (aka BQ) modules sometimes not available when executing
upload_goma_logs.py and upload_goma_logs.py sometimes fail.
Since we need BQ module only if uploading GomaStats to BQ,
let me avoid to load BQ module when it is not used
to minimize the possibility of the execution failure.

Bug:  822103 
Bug: 822042
Change-Id: I213ce4520005a52900eb600d765a217ec21748c3
Reviewed-on: https://chromium-review.googlesource.com/965862
Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Reviewed-by: Takuto Ikuta <tikuta@google.com>

[modify] https://crrev.com/fd888d31f47f99cd6b933c9c2ce026f91f800ea2/scripts/slave/upload_goma_logs.py

Owner: yyanagisawa@chromium.org
Status: Assigned (was: Untriaged)
It appears Yoshisato is on this. Yoshisato, if not, please, state what's left and whose help you need. Thanks.
Project Member

Comment 11 by bugdroid1@chromium.org, Mar 22 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/bf2efddbc1f84363b8f9fdceb732d5b84cdb63be

commit bf2efddbc1f84363b8f9fdceb732d5b84cdb63be
Author: Robert Iannucci <iannucci@chromium.org>
Date: Thu Mar 22 22:16:25 2018

[common/env.py] Remove GetSysPythonPath and GetEnvPythonPath.

GetSysPythonPath is interfering with using vpython for sub-invocations
(and I believe it was actually never necessary and was added due to a
misunderstanding of how PYTHONPATH works).

PYTHONPATH is prefixed to the internal calculation of sys.path of
whatever python interpreter starts up. The interpreter takes PYTHONPATH
from the env, then adds in any libraries which are installed with that
interpreter.

When you're using system python for both runit and also the subprocess,
exporting sys.path to PYTHONPATH is redundant, but not harmful. e.g.
runit would export:

  PYTHONPATH=/build.git:/sys_python

And then when the subpython starts up, it would calculate sys.path to be:

  sys.path=/build.git:/sys_python:/sys_python

However, when you're using vpython to invoke runit and the subprocess
with two different virtualenvs, you get:

  PYTHONPATH=/build.git:/vpython/deadbeef
  sys.path=/build.git:/vpython/deadbeef:/vpython/feedface

Where 'feedface' is the environment that your script actually wants!
By removing GetSysPythonPath from the equation, we'll now do:

  PYTHONPATH=/build.git
  sys.path=/build.git:/vpython/feedface

Which should actually work correctly. I believe that GetSysPythonPath
was added under the assumption that python ONLY consults PYTHONPATH for
libraries when PYTHONPATH is set in the environment, and so we needed
to preserve the current sys.path entries for correct behavior.

GetEnvPythonPath seems to be entirely unused.

R=dnj@chromium.org, nodir@chromium.org, vadimsh@chromium.org, yyanagisawa@chromium.org

Bug: 776430,814607, 822103 ,822042
Change-Id: I8f6a724a6612b8837e0cd1b6fa8ad7a20e793efe
Reviewed-on: https://chromium-review.googlesource.com/974759
Reviewed-by: Marc-Antoine Ruel <maruel@chromium.org>
Reviewed-by: smut <smut@google.com>
Reviewed-by: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Commit-Queue: Robbie Iannucci <iannucci@chromium.org>

[modify] https://crrev.com/bf2efddbc1f84363b8f9fdceb732d5b84cdb63be/scripts/common/env.py
[modify] https://crrev.com/bf2efddbc1f84363b8f9fdceb732d5b84cdb63be/scripts/common/unittests/env_test.py

Project Member

Comment 12 by bugdroid1@chromium.org, Mar 23 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/a4b3c396e413ff37b94203fa18467650d9708471

commit a4b3c396e413ff37b94203fa18467650d9708471
Author: Robbie Iannucci <iannucci@chromium.org>
Date: Thu Mar 22 22:44:56 2018

Revert "[common/env.py] Remove GetSysPythonPath and GetEnvPythonPath."

This reverts commit bf2efddbc1f84363b8f9fdceb732d5b84cdb63be.

Reason for revert: https://logs.chromium.org/v/?s=chromium%2Fbb%2Fchromium%2FLinux_x64%2F60972%2F%2B%2Frecipes%2Fsteps%2Fsizes%2F0%2Fstdout

Original change's description:
> [common/env.py] Remove GetSysPythonPath and GetEnvPythonPath.
> 
> GetSysPythonPath is interfering with using vpython for sub-invocations
> (and I believe it was actually never necessary and was added due to a
> misunderstanding of how PYTHONPATH works).
> 
> PYTHONPATH is prefixed to the internal calculation of sys.path of
> whatever python interpreter starts up. The interpreter takes PYTHONPATH
> from the env, then adds in any libraries which are installed with that
> interpreter.
> 
> When you're using system python for both runit and also the subprocess,
> exporting sys.path to PYTHONPATH is redundant, but not harmful. e.g.
> runit would export:
> 
>   PYTHONPATH=/build.git:/sys_python
> 
> And then when the subpython starts up, it would calculate sys.path to be:
> 
>   sys.path=/build.git:/sys_python:/sys_python
> 
> However, when you're using vpython to invoke runit and the subprocess
> with two different virtualenvs, you get:
> 
>   PYTHONPATH=/build.git:/vpython/deadbeef
>   sys.path=/build.git:/vpython/deadbeef:/vpython/feedface
> 
> Where 'feedface' is the environment that your script actually wants!
> By removing GetSysPythonPath from the equation, we'll now do:
> 
>   PYTHONPATH=/build.git
>   sys.path=/build.git:/vpython/feedface
> 
> Which should actually work correctly. I believe that GetSysPythonPath
> was added under the assumption that python ONLY consults PYTHONPATH for
> libraries when PYTHONPATH is set in the environment, and so we needed
> to preserve the current sys.path entries for correct behavior.
> 
> GetEnvPythonPath seems to be entirely unused.
> 
> R=​dnj@chromium.org, nodir@chromium.org, vadimsh@chromium.org, yyanagisawa@chromium.org
> 
> Bug: 776430,814607, 822103 ,822042
> Change-Id: I8f6a724a6612b8837e0cd1b6fa8ad7a20e793efe
> Reviewed-on: https://chromium-review.googlesource.com/974759
> Reviewed-by: Marc-Antoine Ruel <maruel@chromium.org>
> Reviewed-by: smut <smut@google.com>
> Reviewed-by: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
> Commit-Queue: Robbie Iannucci <iannucci@chromium.org>

TBR=maruel@chromium.org,iannucci@chromium.org,vadimsh@chromium.org,smut@google.com,yyanagisawa@chromium.org,dnj@chromium.org,nodir@chromium.org

Change-Id: I75d7f647a8f2b67cc68b7c055053008b96dabd38
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Bug: 776430, 814607,  822103 , 822042
Reviewed-on: https://chromium-review.googlesource.com/976921
Reviewed-by: Robbie Iannucci <iannucci@chromium.org>
Commit-Queue: Robbie Iannucci <iannucci@chromium.org>

[modify] https://crrev.com/a4b3c396e413ff37b94203fa18467650d9708471/scripts/common/env.py
[modify] https://crrev.com/a4b3c396e413ff37b94203fa18467650d9708471/scripts/common/unittests/env_test.py

Project Member

Comment 13 by bugdroid1@chromium.org, Mar 23 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/e935b61348012b96ebf48f2189d51fe5f6779604

commit e935b61348012b96ebf48f2189d51fe5f6779604
Author: Robert Iannucci <iannucci@chromium.org>
Date: Fri Mar 23 02:22:46 2018

Stop passing flakiness_dash, deprecate generate_json_file.

This is the sole reason that runtest.py imports config, a bug filed in
2014. It appears that this feature is long since abandoned anyway.

R=dpranke@chromium.org, jbudorick@chromium.org, nednguyen@chromium.org, seanmccullough@chromium.org

Bug:  403564 ,776430,814607, 822103 ,822042
Change-Id: Ie3113fe08a111dcd36de54fcf78e274fb201d5a4
Reviewed-on: https://chromium-review.googlesource.com/976876
Reviewed-by: John Budorick <jbudorick@chromium.org>
Commit-Queue: Robbie Iannucci <iannucci@chromium.org>

[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium_trybot.expected/invalid_results.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium.expected/dynamic_gtest_memory_mac64.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium_trybot.expected/compile_because_of_analyze_with_filtered_compile_targets_exclude_all.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipe_modules/chromium_tests/tests/steps/generate_gtest.expected/set_up and tear down.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium.expected/msan.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium.expected/one_failure_keeps_going_dynamic_tests.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipe_modules/chromium/tests/runtest.py
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium_trybot.expected/compile_failure_without_patch_deapply_fn.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium_trybot.expected/dont_deapply_patch.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium.expected/buildnumber_zero.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium.expected/dynamic_gtest_win.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipe_modules/chromium_tests/tests/steps/generate_gtest.expected/basic.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium.expected/dynamic_gtest.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/master/factory/commands.py
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipe_modules/chromium_tests/tests/api/main_waterfall_steps.expected/tester.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium.expected/dynamic_gtest_memory_asan_no_lsan.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/findit/chromium/flake.expected/flakiness_non-swarming_tests.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipe_modules/chromium_tests/tests/api/trybot_steps.expected/basic.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/findit/chromium/test.expected/none_swarming_tests.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipe_modules/webrtc/steps.py
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipe_modules/chromium/api.py
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipe_modules/chromium_tests/steps.py
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipes/chromium.expected/tsan.json
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/README.recipes.md
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/runtest.py
[modify] https://crrev.com/e935b61348012b96ebf48f2189d51fe5f6779604/scripts/slave/recipe_modules/chromium/tests/runtest.expected/annotate.json

Owner: iannucci@chromium.org
I believe Robbie is actually working on this now.
 Issue 819471  has been merged into this issue.
Project Member

Comment 16 by bugdroid1@chromium.org, May 1 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/c55d8676ce4193462972ae3f0d17826ea7b0978f

commit c55d8676ce4193462972ae3f0d17826ea7b0978f
Author: Robert Iannucci <iannucci@chromium.org>
Date: Tue May 01 08:06:38 2018

[common/env.py] Reland: Remove GetSysPythonPath and GetEnvPythonPath.

GetSysPythonPath is interfering with using vpython for sub-invocations
(and I believe it was actually never necessary and was added due to a
misunderstanding of how PYTHONPATH works).

PYTHONPATH is prefixed to the internal calculation of sys.path of
whatever python interpreter starts up. The interpreter takes PYTHONPATH
from the env, then adds in any libraries which are installed with that
interpreter.

When you're using system python for both runit and also the subprocess,
exporting sys.path to PYTHONPATH is redundant, but not harmful. e.g.
runit would export:

  PYTHONPATH=/build.git:/sys_python

And then when the subpython starts up, it would calculate sys.path to be:

  sys.path=/build.git:/sys_python:/sys_python

However, when you're using vpython to invoke runit and the subprocess
with two different virtualenvs, you get:

  PYTHONPATH=/build.git:/vpython/deadbeef
  sys.path=/build.git:/vpython/deadbeef:/vpython/feedface

Where 'feedface' is the environment that your script actually wants!
By removing GetSysPythonPath from the equation, we'll now do:

  PYTHONPATH=/build.git
  sys.path=/build.git:/vpython/feedface

Which should actually work correctly. I believe that GetSysPythonPath
was added under the assumption that python ONLY consults PYTHONPATH for
libraries when PYTHONPATH is set in the environment, and so we needed
to preserve the current sys.path entries for correct behavior.

GetEnvPythonPath seems to be entirely unused.

Original CL: https://chromium-review.googlesource.com/974759
Fix for original revert: https://chromium-review.googlesource.com/976876

R=dnj@chromium.org, nodir@chromium.org, vadimsh@chromium.org, yyanagisawa@chromium.org

Bug: 776430,814607, 822103 ,822042, 825290 
Change-Id: I5eb0d32fd94ae4282f6877c894e6d00f01e810ec
Reviewed-on: https://chromium-review.googlesource.com/976878
Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Reviewed-by: Nodir Turakulov <nodir@chromium.org>

[modify] https://crrev.com/c55d8676ce4193462972ae3f0d17826ea7b0978f/scripts/common/env.py
[modify] https://crrev.com/c55d8676ce4193462972ae3f0d17826ea7b0978f/scripts/common/unittests/env_test.py

Project Member

Comment 17 by bugdroid1@chromium.org, May 1 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/da82356fbf21e140a6b1bc749f85b52adee3aeec

commit da82356fbf21e140a6b1bc749f85b52adee3aeec
Author: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Date: Tue May 01 08:57:19 2018

Revert "[common/env.py] Reland: Remove GetSysPythonPath and GetEnvPythonPath."

This reverts commit c55d8676ce4193462972ae3f0d17826ea7b0978f.

Reason for revert: 
This cl might have broken following builder.
https://ci.chromium.org/buildbot/chromium/Mac/41039

Original change's description:
> [common/env.py] Reland: Remove GetSysPythonPath and GetEnvPythonPath.
> 
> GetSysPythonPath is interfering with using vpython for sub-invocations
> (and I believe it was actually never necessary and was added due to a
> misunderstanding of how PYTHONPATH works).
> 
> PYTHONPATH is prefixed to the internal calculation of sys.path of
> whatever python interpreter starts up. The interpreter takes PYTHONPATH
> from the env, then adds in any libraries which are installed with that
> interpreter.
> 
> When you're using system python for both runit and also the subprocess,
> exporting sys.path to PYTHONPATH is redundant, but not harmful. e.g.
> runit would export:
> 
>   PYTHONPATH=/build.git:/sys_python
> 
> And then when the subpython starts up, it would calculate sys.path to be:
> 
>   sys.path=/build.git:/sys_python:/sys_python
> 
> However, when you're using vpython to invoke runit and the subprocess
> with two different virtualenvs, you get:
> 
>   PYTHONPATH=/build.git:/vpython/deadbeef
>   sys.path=/build.git:/vpython/deadbeef:/vpython/feedface
> 
> Where 'feedface' is the environment that your script actually wants!
> By removing GetSysPythonPath from the equation, we'll now do:
> 
>   PYTHONPATH=/build.git
>   sys.path=/build.git:/vpython/feedface
> 
> Which should actually work correctly. I believe that GetSysPythonPath
> was added under the assumption that python ONLY consults PYTHONPATH for
> libraries when PYTHONPATH is set in the environment, and so we needed
> to preserve the current sys.path entries for correct behavior.
> 
> GetEnvPythonPath seems to be entirely unused.
> 
> Original CL: https://chromium-review.googlesource.com/974759
> Fix for original revert: https://chromium-review.googlesource.com/976876
> 
> R=​dnj@chromium.org, nodir@chromium.org, vadimsh@chromium.org, yyanagisawa@chromium.org
> 
> Bug: 776430,814607, 822103 ,822042, 825290 
> Change-Id: I5eb0d32fd94ae4282f6877c894e6d00f01e810ec
> Reviewed-on: https://chromium-review.googlesource.com/976878
> Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
> Reviewed-by: Nodir Turakulov <nodir@chromium.org>

TBR=iannucci@chromium.org,vadimsh@chromium.org,yyanagisawa@chromium.org,dnj@chromium.org,nodir@chromium.org

Change-Id: I8e786ec50a5f4871391fa2bb658b2331816255ca
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Bug: 776430, 814607,  822103 , 822042,  825290 
Reviewed-on: https://chromium-review.googlesource.com/1037103
Reviewed-by: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>

[modify] https://crrev.com/da82356fbf21e140a6b1bc749f85b52adee3aeec/scripts/common/env.py
[modify] https://crrev.com/da82356fbf21e140a6b1bc749f85b52adee3aeec/scripts/common/unittests/env_test.py

Cc: d...@chromium.org
You can understand how it flaky from
https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyHwsSBUZsYWtlIhRwb3N0cHJvY2Vzc19mb3JfZ29tYQw

My interests is how to make uploading GomaStats stable and I am not interested in evangelizing vpython.  If vpython is not a good choice, I can re-implement code with something else.
Project Member

Comment 20 by bugdroid1@chromium.org, May 14 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/677b29788aedb625fdbfd5b75cd09cbbc406fb72

commit 677b29788aedb625fdbfd5b75cd09cbbc406fb72
Author: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Date: Mon May 14 02:33:23 2018

[common/env.py] Reland: Remove GetSysPythonPath and GetEnvPythonPath."

This reverts commit da82356fbf21e140a6b1bc749f85b52adee3aeec.

Reason for reland:
The fix has been landed:
https://chromium-review.googlesource.com/c/chromium/src/+/1053674

Original change's description:
> Revert "[common/env.py] Reland: Remove GetSysPythonPath and GetEnvPythonPath."
> 
> This reverts commit c55d8676ce4193462972ae3f0d17826ea7b0978f.
> 
> Reason for revert: 
> This cl might have broken following builder.
> https://ci.chromium.org/buildbot/chromium/Mac/41039
> 
> Original change's description:
> > [common/env.py] Reland: Remove GetSysPythonPath and GetEnvPythonPath.
> > 
> > GetSysPythonPath is interfering with using vpython for sub-invocations
> > (and I believe it was actually never necessary and was added due to a
> > misunderstanding of how PYTHONPATH works).
> > 
> > PYTHONPATH is prefixed to the internal calculation of sys.path of
> > whatever python interpreter starts up. The interpreter takes PYTHONPATH
> > from the env, then adds in any libraries which are installed with that
> > interpreter.
> > 
> > When you're using system python for both runit and also the subprocess,
> > exporting sys.path to PYTHONPATH is redundant, but not harmful. e.g.
> > runit would export:
> > 
> >   PYTHONPATH=/build.git:/sys_python
> > 
> > And then when the subpython starts up, it would calculate sys.path to be:
> > 
> >   sys.path=/build.git:/sys_python:/sys_python
> > 
> > However, when you're using vpython to invoke runit and the subprocess
> > with two different virtualenvs, you get:
> > 
> >   PYTHONPATH=/build.git:/vpython/deadbeef
> >   sys.path=/build.git:/vpython/deadbeef:/vpython/feedface
> > 
> > Where 'feedface' is the environment that your script actually wants!
> > By removing GetSysPythonPath from the equation, we'll now do:
> > 
> >   PYTHONPATH=/build.git
> >   sys.path=/build.git:/vpython/feedface
> > 
> > Which should actually work correctly. I believe that GetSysPythonPath
> > was added under the assumption that python ONLY consults PYTHONPATH for
> > libraries when PYTHONPATH is set in the environment, and so we needed
> > to preserve the current sys.path entries for correct behavior.
> > 
> > GetEnvPythonPath seems to be entirely unused.
> > 
> > Original CL: https://chromium-review.googlesource.com/974759
> > Fix for original revert: https://chromium-review.googlesource.com/976876
> > 
> > R=​dnj@chromium.org, nodir@chromium.org, vadimsh@chromium.org, yyanagisawa@chromium.org
> > 
> > Bug: 776430,814607, 822103 ,822042, 825290 
> > Change-Id: I5eb0d32fd94ae4282f6877c894e6d00f01e810ec
> > Reviewed-on: https://chromium-review.googlesource.com/976878
> > Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
> > Reviewed-by: Nodir Turakulov <nodir@chromium.org>
> 
> TBR=iannucci@chromium.org,vadimsh@chromium.org,yyanagisawa@chromium.org,dnj@chromium.org,nodir@chromium.org
> 
> Change-Id: I8e786ec50a5f4871391fa2bb658b2331816255ca
> No-Presubmit: true
> No-Tree-Checks: true
> No-Try: true
> Bug: 776430, 814607,  822103 , 822042,  825290 
> Reviewed-on: https://chromium-review.googlesource.com/1037103
> Reviewed-by: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
> Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>

TBR=iannucci@chromium.org,vadimsh@chromium.org,yyanagisawa@chromium.org,dnj@chromium.org,nodir@chromium.org

# Not skipping CQ checks because original CL landed > 1 day ago.

Bug: 776430, 814607,  822103 , 822042,  825290 
Change-Id: I2035a01125452fbb63fbb93f8fe01a9415ac52e0
Reviewed-on: https://chromium-review.googlesource.com/1054909
Reviewed-by: Nodir Turakulov <nodir@chromium.org>
Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>

[modify] https://crrev.com/677b29788aedb625fdbfd5b75cd09cbbc406fb72/scripts/common/env.py
[modify] https://crrev.com/677b29788aedb625fdbfd5b75cd09cbbc406fb72/scripts/common/unittests/env_test.py

There seems not be flakiness update yesterday.
If we do not see the flakiness for a week, I am going to close the issue.
Project Member

Comment 22 by bugdroid1@chromium.org, May 15 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/c802f8211a5018cfd2a6913e1023c51c76c870dd

commit c802f8211a5018cfd2a6913e1023c51c76c870dd
Author: Michael Moss <mmoss@chromium.org>
Date: Tue May 15 22:50:08 2018

Revert "[common/env.py] Reland: Remove GetSysPythonPath and GetEnvPythonPath.""

This reverts commit 677b29788aedb625fdbfd5b75cd09cbbc406fb72.

Reason for revert: Breaking official release builds. See discussion in  crbug.com/843012.

Original change's description:
> [common/env.py] Reland: Remove GetSysPythonPath and GetEnvPythonPath."
> 
> This reverts commit da82356fbf21e140a6b1bc749f85b52adee3aeec.
> 
> Reason for reland:
> The fix has been landed:
> https://chromium-review.googlesource.com/c/chromium/src/+/1053674
> 
> Original change's description:
> > Revert "[common/env.py] Reland: Remove GetSysPythonPath and GetEnvPythonPath."
> > 
> > This reverts commit c55d8676ce4193462972ae3f0d17826ea7b0978f.
> > 
> > Reason for revert: 
> > This cl might have broken following builder.
> > https://ci.chromium.org/buildbot/chromium/Mac/41039
> > 
> > Original change's description:
> > > [common/env.py] Reland: Remove GetSysPythonPath and GetEnvPythonPath.
> > > 
> > > GetSysPythonPath is interfering with using vpython for sub-invocations
> > > (and I believe it was actually never necessary and was added due to a
> > > misunderstanding of how PYTHONPATH works).
> > > 
> > > PYTHONPATH is prefixed to the internal calculation of sys.path of
> > > whatever python interpreter starts up. The interpreter takes PYTHONPATH
> > > from the env, then adds in any libraries which are installed with that
> > > interpreter.
> > > 
> > > When you're using system python for both runit and also the subprocess,
> > > exporting sys.path to PYTHONPATH is redundant, but not harmful. e.g.
> > > runit would export:
> > > 
> > >   PYTHONPATH=/build.git:/sys_python
> > > 
> > > And then when the subpython starts up, it would calculate sys.path to be:
> > > 
> > >   sys.path=/build.git:/sys_python:/sys_python
> > > 
> > > However, when you're using vpython to invoke runit and the subprocess
> > > with two different virtualenvs, you get:
> > > 
> > >   PYTHONPATH=/build.git:/vpython/deadbeef
> > >   sys.path=/build.git:/vpython/deadbeef:/vpython/feedface
> > > 
> > > Where 'feedface' is the environment that your script actually wants!
> > > By removing GetSysPythonPath from the equation, we'll now do:
> > > 
> > >   PYTHONPATH=/build.git
> > >   sys.path=/build.git:/vpython/feedface
> > > 
> > > Which should actually work correctly. I believe that GetSysPythonPath
> > > was added under the assumption that python ONLY consults PYTHONPATH for
> > > libraries when PYTHONPATH is set in the environment, and so we needed
> > > to preserve the current sys.path entries for correct behavior.
> > > 
> > > GetEnvPythonPath seems to be entirely unused.
> > > 
> > > Original CL: https://chromium-review.googlesource.com/974759
> > > Fix for original revert: https://chromium-review.googlesource.com/976876
> > > 
> > > R=​dnj@chromium.org, nodir@chromium.org, vadimsh@chromium.org, yyanagisawa@chromium.org
> > > 
> > > Bug: 776430,814607, 822103 ,822042, 825290 
> > > Change-Id: I5eb0d32fd94ae4282f6877c894e6d00f01e810ec
> > > Reviewed-on: https://chromium-review.googlesource.com/976878
> > > Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
> > > Reviewed-by: Nodir Turakulov <nodir@chromium.org>
> > 
> > TBR=iannucci@chromium.org,vadimsh@chromium.org,yyanagisawa@chromium.org,dnj@chromium.org,nodir@chromium.org
> > 
> > Change-Id: I8e786ec50a5f4871391fa2bb658b2331816255ca
> > No-Presubmit: true
> > No-Tree-Checks: true
> > No-Try: true
> > Bug: 776430, 814607,  822103 , 822042,  825290 
> > Reviewed-on: https://chromium-review.googlesource.com/1037103
> > Reviewed-by: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
> > Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
> 
> TBR=iannucci@chromium.org,vadimsh@chromium.org,yyanagisawa@chromium.org,dnj@chromium.org,nodir@chromium.org
> 
> # Not skipping CQ checks because original CL landed > 1 day ago.
> 
> Bug: 776430, 814607,  822103 , 822042,  825290 
> Change-Id: I2035a01125452fbb63fbb93f8fe01a9415ac52e0
> Reviewed-on: https://chromium-review.googlesource.com/1054909
> Reviewed-by: Nodir Turakulov <nodir@chromium.org>
> Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>

TBR=iannucci@chromium.org,vadimsh@chromium.org,yyanagisawa@chromium.org,dnj@chromium.org,nodir@chromium.org

# Not skipping CQ checks because original CL landed > 1 day ago.

Bug: 776430, 814607,  822103 , 822042,  825290 , 843012
Change-Id: I4ccffdc3f1fe9fa878ef78a0212c8b39d91c0189
Reviewed-on: https://chromium-review.googlesource.com/1060394
Reviewed-by: Michael Moss <mmoss@chromium.org>
Commit-Queue: Michael Moss <mmoss@chromium.org>

[modify] https://crrev.com/c802f8211a5018cfd2a6913e1023c51c76c870dd/scripts/common/env.py
[modify] https://crrev.com/c802f8211a5018cfd2a6913e1023c51c76c870dd/scripts/common/unittests/env_test.py

Project Member

Comment 23 by bugdroid1@chromium.org, May 22 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/ab63c10029dc010d0178057775b4817b7dbf01b3

commit ab63c10029dc010d0178057775b4817b7dbf01b3
Author: Yoshisato Yanagisawa <yyanagisawa@chromium.org>
Date: Tue May 22 01:07:26 2018

[common/env.py] Remove GetSysPythonPath.

This reverts commit c802f8211a5018cfd2a6913e1023c51c76c870dd.
Since PYTHONPATH need to be loaded for official builder,
let me remove GetSysPythonPath by default but allow to add
PYTHONPATH if with_third_party_lib is set.

Bug: 776430, 814607,  822103 , 822042,  825290 , 843012, 843012
Change-Id: Idc7306ce33e083c235f6e3c7f3a7d2e1d5d618b3
Reviewed-on: https://chromium-review.googlesource.com/1067224
Reviewed-by: Michael Moss <mmoss@chromium.org>
Commit-Queue: Yoshisato Yanagisawa <yyanagisawa@chromium.org>

[modify] https://crrev.com/ab63c10029dc010d0178057775b4817b7dbf01b3/scripts/common/env.py
[modify] https://crrev.com/ab63c10029dc010d0178057775b4817b7dbf01b3/scripts/common/unittests/env_test.py

Owner: yyanagisawa@chromium.org
Status: Fixed (was: Assigned)
Since we do not see any additional flakiness after landing https://chromium-review.googlesource.com/c/chromium/tools/build/+/1067224, let me think the issue fixed.

Sign in to add a comment