eve informational chrome pfq failed at BuildPackages stage |
||||
Issue descriptionThe failure started from https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8942551157883868704 chromeos-chrome-69.0.3475.0_alpha-r1: [0m * GN_ARGS = is_debug=false use_v4l2_codec=true use_v4lplugin=false use_vaapi=true use_ozone=true use_evdev_gestures=true use_xkbcommon=true linux_use_bundled_binutils=false use_debug_fission=false enable_remoting=true enable_nacl=true icu_use_data_file=true use_cras=true use_system_harfbuzz=false use_system_freetype=false use_system_libsync=true use_cups=true use_jumbo_build=false use_bundled_fontconfig=false is_asan=false is_clang=true cros_host_is_clang=true cros_v8_snapshot_is_clang=true clang_use_chrome_plugins=false use_thin_lto=true use_lld=false is_cfi=true use_cfi_cast=true ozone_auto_platforms=false ozone_platform_gbm=true use_system_minigbm=true use_system_libdrm=true is_chrome_branded=true is_official_build=true internal_gles2_conform_tests=true treat_warnings_as_errors=false use_goma=true use_debug_fission=true symbol_level=2 target_sysroot="/build/eve" system_libdir="lib64" pkg_config="/build/eve/build/bin/pkg-config" target_os="chromeos" host_pkg_config="x86_64-pc-linux-gnu-pkg-config" ozone_platform="gbm" target_cpu="x64" goma_dir="/home/chrome-bot/goma" cros_target_ar="llvm-ar" cros_target_cc="x86_64-cros-linux-gnu-clang -B/usr/x86_64-pc-linux-gnu/x86_64-cros-linux-gnu/binutils-bin/2.27.0-gold" cros_target_cxx="x86_64-cros-linux-gnu-clang++ -B/usr/x86_64-pc-linux-gnu/x86_64-cros-linux-gnu/binutils-bin/2.27.0-gold" host_toolchain="//build/toolchain/cros:host" custom_toolchain="//build/toolchain/cros:target" v8_snapshot_toolchain="//build/toolchain/cros:v8_snapshot" cros_target_ld="x86_64-cros-linux-gnu-clang++ -B/usr/x86_64-pc-linux-gnu/x86_64-cros-linux-gnu/binutils-bin/2.27.0-gold" cros_target_extra_cflags="-pipe -pipe -march=corei7 -fno-split-dwarf-inlining -fdebug-info-for-profiling -Wno-unknown-warning-option " cros_target_extra_cppflags="" cros_target_extra_cxxflags="-pipe -pipe -pipe -march=corei7 -fno-split-dwarf-inlining -fdebug-info-for-profiling -D__google_stl_debug_vector=1 -Wno-unknown-warning-option -stdlib=libc++ " cros_target_extra_ldflags="-Wl,-O1 -Wl,-O2 -Wl,--as-needed -stdlib=libc++ -Wl,-plugin-opt,-import-instr-limit=30" cros_host_cc="x86_64-pc-linux-gnu-clang -B/usr/bin" cros_host_cxx="x86_64-pc-linux-gnu-clang++ -B/usr/bin" cros_host_ar="llvm-ar" cros_host_ld="x86_64-pc-linux-gnu-clang++" cros_host_extra_cflags=" -Wno-unknown-warning-option" cros_host_extra_cxxflags=" -Wno-unknown-warning-option" cros_host_extra_cppflags="" cros_host_extra_ldflags="" cros_v8_snapshot_cc="x86_64-pc-linux-gnu-clang -B/usr/bin" cros_v8_snapshot_cxx="x86_64-pc-linux-gnu-clang++ -B/usr/bin" cros_v8_snapshot_ar="llvm-ar" cros_v8_snapshot_ld="x86_64-pc-linux-gnu-clang++" cros_v8_snapshot_extra_cflags=" -Wno-unknown-warning-option" cros_v8_snapshot_extra_cxxflags=" -Wno-unknown-warning-option" cros_v8_snapshot_extra_cppflags="" cros_v8_snapshot_extra_ldflags="" chromeos-chrome-69.0.3475.0_alpha-r1: /build/eve/tmp/portage/chromeos-base/chromeos-chrome-69.0.3475.0_alpha-r1/temp/environment: line 4319: /home/chrome-bot/chrome_root/src/buildtools/linux64/gn: No such file or directory chromeos-chrome-69.0.3475.0_alpha-r1: * ERROR: chromeos-base/chromeos-chrome-69.0.3475.0_alpha-r1::chromiumos failed (configure phase): chromeos-chrome-69.0.3475.0_alpha-r1: * (no error message) chromeos-chrome-69.0.3475.0_alpha-r1: * chromeos-chrome-69.0.3475.0_alpha-r1: * Call stack: chromeos-chrome-69.0.3475.0_alpha-r1: * ebuild.sh, line 133: Called src_configure chromeos-chrome-69.0.3475.0_alpha-r1: * environment, line 4319: Called die chromeos-chrome-69.0.3475.0_alpha-r1: * The specific snippet of code: chromeos-chrome-69.0.3475.0_alpha-r1: * ${EGN} gen "${CHROME_ROOT}/src/${BUILD_OUT_SYM}/${BUILDTYPE}" --args="${GN_ARGS}" --root="${CHROME_ROOT}/src" || die; chromeos-chrome-69.0.3475.0_alpha-r1: * S: '/build/eve/tmp/portage/chromeos-base/chromeos-chrome-69.0.3475.0_alpha-r1/work/chromeos-chrome-69.0.3475.0_alpha' chromeos-chrome-69.0.3475.0_alpha-r1: >>> Failed to emerge chromeos-base/chromeos-chrome-69.0.3475.0_alpha-r1 for /build/eve/, Log file: chromeos-chrome-69.0.3475.0_alpha-r1: >>> '/build/eve/tmp/portage/logs/chromeos-base:chromeos-chrome-69.0.3475.0_alpha-r1:20180627-171856.log' chromeos-chrome-69.0.3475.0_alpha-r1: chromeos-chrome-69.0.3475.0_alpha-r1: * Messages for package chromeos-base/chromeos-chrome-69.0.3475.0_alpha-r1 merged to /build/eve/: chromeos-chrome-69.0.3475.0_alpha-r1: chromeos-chrome-69.0.3475.0_alpha-r1: * CHROME_ORIGIN VALUE is LOCAL_SOURCE chromeos-chrome-69.0.3475.0_alpha-r1: * /home/chrome-bot/chrome_root should be set here properly chromeos-chrome-69.0.3475.0_alpha-r1: * ERROR: chromeos-base/chromeos-chrome-69.0.3475.0_alpha-r1::chromiumos failed (configure phase): chromeos-chrome-69.0.3475.0_alpha-r1: * (no error message) chromeos-chrome-69.0.3475.0_alpha-r1: * chromeos-chrome-69.0.3475.0_alpha-r1: * Call stack: chromeos-chrome-69.0.3475.0_alpha-r1: * ebuild.sh, line 133: Called src_configure chromeos-chrome-69.0.3475.0_alpha-r1: * environment, line 4319: Called die chromeos-chrome-69.0.3475.0_alpha-r1: * The specific snippet of code: chromeos-chrome-69.0.3475.0_alpha-r1: * ${EGN} gen "${CHROME_ROOT}/src/${BUILD_OUT_SYM}/${BUILDTYPE}" --args="${GN_ARGS}" --root="${CHROME_ROOT}/src" || die; chromeos-chrome-69.0.3475.0_alpha-r1: * Failed chromeos-base/chromeos-chrome-69.0.3475.0_alpha-r1 (in 0m8.2s). Your build has failed. Pending 21/821, [Time 10:19:04 | Elapsed 21m13.7s | Load 7.25 40.77 43.16] Packages failed: chromeos-base/chromeos-chrome-69.0.3475.0_alpha-r1 using /tmp/goma_tmp_dir.WXBEmf as tmpdir Killing compiler proxy. compiler proxy status: http://127.0.0.1:8088 quit! ERROR : Wed Jun 27 10:19:06 PDT 2018 ERROR : PGID PPID PID ELAPSED TIME %CPU COMMAND ERROR : Arguments of 10: ./build_packages '--board=eve' '--accept_licenses=@CHROMEOS' '--withdebugsymbols' '--skip_chroot_upgrade' '--run_goma' '--withevents' '--eventfile=/mnt/host/source/buildbot_archive/eve-tot-chrome-pfq-informational/R69-10822.0.0-b2701511/build-events.json' '--save_install_plan=/tmp/eve_install_plan.2701511' 'virtual/target-os' 'virtual/target-os-dev' 'virtual/target-os-test' 'virtual/target-os-factory' 'virtual/target-os-factory-shim' 'chromeos-base/autotest-all' ERROR : Backtrace: (most recent call is last) ERROR : build_packages:368:main(), called: die_err_trap ERROR : ERROR : Command failed: ERROR : Command '( if [[ "${FLAGS_run_goma}" -eq "${FLAGS_TRUE}" ]]; then ERROR : info "Starting goma compiler_proxy."; goma_ctl="${GOMA_DIR:-${HOME}/goma}/goma_ctl.py"; "${goma_ctl}" restart; trap "'${goma_ctl}' stop" EXIT; ERROR : fi; set -o pipefail; sudo -E "${EMERGE_CMD[@]}" "${EMERGE_FLAGS[@]}" "${PACKAGES[@]}" | tee "${tmpfile}" )' exited with nonzero code: 1 [1;31m10:19:06: ERROR:
,
Jun 27 2018
Confirmed that the failure was gone with the reverted CL in place.
,
Jun 28 2018
The same error showed up on all informational builders again. Since the CL in #1 got relanded in https://chromium-review.googlesource.com/c/chromium/src/+/1117264, I guess it broke the builds again?
,
Jun 28 2018
The CL has been reverted. I'll wait and see if it can fix the builds.
But by looking more deeply in the log, it seems the error message changes slightly:
chromeos-chrome-69.0.3476.0_alpha-r1: The gn binary has moved, please re-run `gn gen <your-out-dir>`.
chromeos-chrome-69.0.3476.0_alpha-r1: * ERROR: chromeos-base/chromeos-chrome-69.0.3476.0_alpha-r1::chromiumos failed (configure phase):
chromeos-chrome-69.0.3476.0_alpha-r1: * (no error message)
chromeos-chrome-69.0.3476.0_alpha-r1: * Call stack:
chromeos-chrome-69.0.3476.0_alpha-r1: * ebuild.sh, line 133: Called src_configure
chromeos-chrome-69.0.3476.0_alpha-r1: * environment, line 4319: Called die
chromeos-chrome-69.0.3476.0_alpha-r1: * The specific snippet of code:
chromeos-chrome-69.0.3476.0_alpha-r1: * ${EGN} gen "${CHROME_ROOT}/src/${BUILD_OUT_SYM}/${BUILDTYPE}" --args="${GN_ARGS}" --root="${CHROME_ROOT}/src" || die;
So looks like the error in #0 complained about "buildtools/linux64/gn: No such file or directory" with the first attempt CL in place, and the error that's happening right now complained about "The gn binary has moved".
According to offline chat with scottmy@, he said "in chromium, gn is always run through depot_tools/gn.py, which will now find third_party/gn/gn which is where gn lives after my change. buildtools/linux64/gn (the old location) was changed to error out because we didn't want someone to rely on the old gn location once new features were added to gn. but i guess the chromeos build process points directly at buildtools/linux64/gn, so we'd need to track down where that happens and update it to point at third_party/gn/gn instead."
,
Jun 28 2018
One of the informational builder has just cycled green: https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8942456519809358416. So it seems the revert does fix the failure. I'll wait and see if the failure goes away on other informational builders as well.
,
Jun 28 2018
Thanks for the update.
,
Jun 29 2018
Close this one as it's no longer present. |
||||
►
Sign in to add a comment |
||||
Comment 1 by x...@chromium.org
, Jun 27 2018