Issue metadata
Sign in to add a comment
|
amd64-generic-fuzzer builder failing in build packages |
||||||||||||||||||||||||
Issue descriptionhttps://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8940109292639808128 2 issues: 1. Failing to fetch virglrenderer sources. virglrenderer-0.6.0_p20180716-r2: >>> Fetching (1 of 1) media-libs/virglrenderer-0.6.0_p20180716-r2::chromiumos for /build/amd64-generic/ virglrenderer-0.6.0_p20180716-r2: curl: (22) The requested URL returned error: 404 Not Found virglrenderer-0.6.0_p20180716-r2: !!! Couldn't download 'virglrenderer-0.6.0_p20180716.tar.gz'. Aborting. virglrenderer-0.6.0_p20180716-r2: * Fetch failed for 'media-libs/virglrenderer-0.6.0_p20180716-r2' 2. llvm-6.0 is leaking memory in tblgen: llvm-6.0.0: * ASAN error detected: llvm-6.0.0: * llvm-6.0.0: * ================================================================= llvm-6.0.0: * ==3798==ERROR: LeakSanitizer: detected memory leaks llvm-6.0.0: * llvm-6.0.0: * Direct leak of 334560 byte(s) in 1394 object(s) allocated from: llvm-6.0.0: * #0 0x4f6922 in operator new(unsigned long) (/build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0-x86_64-pc-linux-gnu/bin/llvm-tblgen+0x4f6922) llvm-6.0.0: * #1 0x6c32d4 in (anonymous namespace)::TupleExpander::expand(llvm::SetTheory&, llvm::Record*, llvm::SmallSetVector<llvm::Record*, 16u>&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/CodeGenRegisters.cpp:649:24 llvm-6.0.0: * #2 0xb3e13f in llvm::SetTheory::expand(llvm::Record*) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/lib/TableGen/SetTheory.cpp:326:18 llvm-6.0.0: * #3 0x6a94a7 in llvm::CodeGenRegBank::CodeGenRegBank(llvm::RecordKeeper&, llvm::CodeGenHwModes const&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/CodeGenRegisters.cpp:1089:43 llvm-6.0.0: * #4 0x770471 in std::__1::enable_if<!(std::is_array<llvm::CodeGenRegBank>::value), std::__1::unique_ptr<llvm::CodeGenRegBank, std::__1::default_delete<llvm::CodeGenRegBank> > >::type llvm::make_unique<llvm::CodeGenRegBank, llvm::RecordKeeper&, llvm::CodeGenHwModes const&>(llvm::RecordKeeper&&&, llvm::CodeGenHwModes const&&&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/include/llvm/ADT/STLExtras.h:945:33 llvm-6.0.0: * #5 0x75a149 in llvm::CodeGenTarget::getRegBank() const /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/CodeGenTarget.cpp:271:15 llvm-6.0.0: * #6 0x916b45 in (anonymous namespace)::RegisterInfoEmitter::RegisterInfoEmitter(llvm::RecordKeeper&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/RegisterInfoEmitter.cpp:63:38 llvm-6.0.0: * #7 0x916ad2 in llvm::EmitRegisterInfo(llvm::RecordKeeper&, llvm::raw_ostream&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/RegisterInfoEmitter.cpp:1643:3 llvm-6.0.0: * #8 0x99fb3f in (anonymous namespace)::LLVMTableGenMain(llvm::raw_ostream&, llvm::RecordKeeper&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/TableGen.cpp:124:5 llvm-6.0.0: * #9 0xb0f321 in llvm::TableGenMain(char*, bool (*)(llvm::raw_ostream&, llvm::RecordKeeper&)) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/lib/TableGen/Main.cpp:109:7 llvm-6.0.0: * #10 0x99fa71 in main /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/TableGen.cpp:223:10 llvm-6.0.0: * #11 0x7f923a37c72f in __libc_start_main (/lib64/libc.so.6+0x2072f) llvm-6.0.0: * llvm-6.0.0: * Indirect leak of 501840 byte(s) in 1394 object(s) allocated from: llvm-6.0.0: * #0 0x4c9982 in realloc (/build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0-x86_64-pc-linux-gnu/bin/llvm-tblgen+0x4c9982) llvm-6.0.0: * #1 0xa43169 in llvm::SmallVectorBase::grow_pod(void*, unsigned long, unsigned long) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/lib/Support/SmallVector.cpp:36:15 llvm-6.0.0: * #2 0x6fac69 in llvm::SmallVectorTemplateCommon<llvm::RecordVal, void>::grow_pod(unsigned long, unsigned long) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/include/llvm/ADT/SmallVector.h:83:22 llvm-6.0.0: * #3 0x6fabff in llvm::SmallVectorTemplateBase<llvm::RecordVal, true>::grow(unsigned long) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/include/llvm/ADT/SmallVector.h:305:11 llvm-6.0.0: * #4 0x6fab72 in llvm::SmallVectorTemplateBase<llvm::RecordVal, true>::push_back(llvm::RecordVal const&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/include/llvm/ADT/SmallVector.h:311:13 llvm-6.0.0: * #5 0x6f7789 in llvm::Record::addValue(llvm::RecordVal const&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/include/llvm/TableGen/Record.h:1370:12 llvm-6.0.0: * #6 0x6c4352 in (anonymous namespace)::TupleExpander::expand(llvm::SetTheory&, llvm::Record*, llvm::SmallSetVector<llvm::Record*, 16u>&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/CodeGenRegisters.cpp:686:19 llvm-6.0.0: * #7 0xb3e13f in llvm::SetTheory::expand(llvm::Record*) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/lib/TableGen/SetTheory.cpp:326:18 llvm-6.0.0: * #8 0x6a94a7 in llvm::CodeGenRegBank::CodeGenRegBank(llvm::RecordKeeper&, llvm::CodeGenHwModes const&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/CodeGenRegisters.cpp:1089:43 llvm-6.0.0: * #9 0x770471 in std::__1::enable_if<!(std::is_array<llvm::CodeGenRegBank>::value), std::__1::unique_ptr<llvm::CodeGenRegBank, std::__1::default_delete<llvm::CodeGenRegBank> > >::type llvm::make_unique<llvm::CodeGenRegBank, llvm::RecordKeeper&, llvm::CodeGenHwModes const&>(llvm::RecordKeeper&&&, llvm::CodeGenHwModes const&&&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/include/llvm/ADT/STLExtras.h:945:33 llvm-6.0.0: * #10 0x75a149 in llvm::CodeGenTarget::getRegBank() const /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/CodeGenTarget.cpp:271:15 llvm-6.0.0: * #11 0x916b45 in (anonymous namespace)::RegisterInfoEmitter::RegisterInfoEmitter(llvm::RecordKeeper&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/RegisterInfoEmitter.cpp:63:38 llvm-6.0.0: * #12 0x916ad2 in llvm::EmitRegisterInfo(llvm::RecordKeeper&, llvm::raw_ostream&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/RegisterInfoEmitter.cpp:1643:3 llvm-6.0.0: * #13 0x99fb3f in (anonymous namespace)::LLVMTableGenMain(llvm::raw_ostream&, llvm::RecordKeeper&) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/TableGen.cpp:124:5 llvm-6.0.0: * #14 0xb0f321 in llvm::TableGenMain(char*, bool (*)(llvm::raw_ostream&, llvm::RecordKeeper&)) /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/lib/TableGen/Main.cpp:109:7 llvm-6.0.0: * #15 0x99fa71 in main /build/amd64-generic/tmp/portage/sys-devel/llvm-6.0.0/work/llvm-6.0.0.src/utils/TableGen/TableGen.cpp:223:10 llvm-6.0.0: * #16 0x7f923a37c72f in __libc_start_main (/lib64/libc.so.6+0x2072f)
,
Jul 24
,
Jul 24
As a heads up, the fuzzer is still waiting for two patches to land in upstream mesa to be able to work in clusterfuzz.
,
Jul 24
Thanks David, the issue here is in building llvm itself. If it does not build, we can't fuzz anything. Root cause seems to be that target LDFLAGS are leaking into host tablegen builds. Setting LDFLAGS to '' seems to fix it.
,
Jul 24
I encountered a few more issues when building: 1. Mesa needs libelf 2. virglrenderer needs gbm support in mesa. Will check after https://chromium-review.googlesource.com/c/chromiumos/overlays/chromiumos-overlay/+/1148992 lands.
,
Jul 25
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/13a6eb999fb6ec8d0b17ce6d72d1ff83fbeaddb9 commit 13a6eb999fb6ec8d0b17ce6d72d1ff83fbeaddb9 Author: Manoj Gupta <manojgupta@google.com> Date: Wed Jul 25 23:35:17 2018 llvm: Clear LDFLAGS when building host binaries. Portage will pass LD Flags for target into the host binary builds if not cleared. This fixes the llvm build failure on amd64-generic-fuzzer builder. BUG= chromium:867022 TEST=llvm builds. Change-Id: I788de1f503e81bbe87890232b93b13c5fa9099c1 Reviewed-on: https://chromium-review.googlesource.com/1148992 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: David Riley <davidriley@chromium.org> [modify] https://crrev.com/13a6eb999fb6ec8d0b17ce6d72d1ff83fbeaddb9/sys-devel/llvm/llvm-6.0.0.ebuild [add] https://crrev.com/13a6eb999fb6ec8d0b17ce6d72d1ff83fbeaddb9/sys-devel/llvm/llvm-6.0.0-r1.ebuild
,
Jul 26
The recent run is still failing on the bot. I'll revert my change.
,
Jul 26
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/7f14bdc94d31898de4ff8b6c2d6cada3c009250a commit 7f14bdc94d31898de4ff8b6c2d6cada3c009250a Author: Pohsien Wang <pwang@chromium.org> Date: Thu Jul 26 13:29:12 2018 Revert "chromium-os-fuzzers: Add virglrenderer" This reverts commit d1d15cd1ef9d9dda928313dcb94f6bc1d25e0b50. Reason for revert: The builder start failing in the build stage. Temporary revert this change so that others are unblocked. BUG= chromium:867022 Original change's description: > chromium-os-fuzzers: Add virglrenderer > > BUG= chromium:852111 > TEST=emerge-amd64-generic chromium-os-fuzzers > CQ-DEPEND=CL:1100122, CL:1140741 > > Change-Id: Ibedd3609f375a40fdc82e50aee553ed12668b3b4 > Reviewed-on: https://chromium-review.googlesource.com/1105572 > Commit-Ready: Pohsien Wang <pwang@chromium.org> > Tested-by: Pohsien Wang <pwang@chromium.org> > Reviewed-by: Manoj Gupta <manojgupta@chromium.org> > Reviewed-by: Pohsien Wang <pwang@chromium.org> Bug: chromium:852111 Change-Id: I5487efb7c6615043af8febf73485bff9b712e083 Reviewed-on: https://chromium-review.googlesource.com/1150980 Commit-Ready: Pohsien Wang <pwang@chromium.org> Tested-by: Pohsien Wang <pwang@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Pohsien Wang <pwang@chromium.org> [modify] https://crrev.com/7f14bdc94d31898de4ff8b6c2d6cada3c009250a/virtual/chromium-os-fuzzers/chromium-os-fuzzers-1.ebuild [rename] https://crrev.com/7f14bdc94d31898de4ff8b6c2d6cada3c009250a/virtual/chromium-os-fuzzers/chromium-os-fuzzers-1-r7.ebuild
,
Jul 27
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/board-overlays/+/a47c4bc8eba12d0019793d7a25db97df99b4415d commit a47c4bc8eba12d0019793d7a25db97df99b4415d Author: Manoj Gupta <manojgupta@google.com> Date: Fri Jul 27 03:45:07 2018 fuzzing: Build mesa with gbm. virglrenderer needs gbm support to build. BUG= chromium:867022 TEST=virglrenderer builds. Change-Id: I821b007c88e046184e6a452fd0d85540540eb2c9 Reviewed-on: https://chromium-review.googlesource.com/1151717 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Mike Frysinger <vapier@chromium.org> [add] https://crrev.com/a47c4bc8eba12d0019793d7a25db97df99b4415d/overlay-amd64-generic/profiles/fuzzer/package.use
,
Jul 27
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/b11390846c98686693ac70b19b8503f2df3511bf commit b11390846c98686693ac70b19b8503f2df3511bf Author: Manoj Gupta <manojgupta@google.com> Date: Fri Jul 27 03:50:08 2018 mesa: Add dependency on libelf with llvm. Mesa needs libelf with llvm. Fixes following error in amd64-generic-fuzzer builder: mesa-18.2_pre1-r7: configure: error: r600 requires libelf when using llvm. BUG= chromium:867022 TEST=mesa builds. Change-Id: I3b4d5ad5522907cac8cec6e5ee5d4519a30f1460 Reviewed-on: https://chromium-review.googlesource.com/1151537 Commit-Queue: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Trybot-Ready: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Pohsien Wang <pwang@chromium.org> [modify] https://crrev.com/b11390846c98686693ac70b19b8503f2df3511bf/media-libs/mesa/mesa-9999.ebuild [rename] https://crrev.com/b11390846c98686693ac70b19b8503f2df3511bf/media-libs/mesa/mesa-18.2_pre1-r8.ebuild [modify] https://crrev.com/b11390846c98686693ac70b19b8503f2df3511bf/media-libs/mesa/mesa-18.2_pre1.ebuild
,
Jul 27
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/4505a078b2a45036cf97227a5c15d748d028f945 commit 4505a078b2a45036cf97227a5c15d748d028f945 Author: Manoj Gupta <manojgupta@google.com> Date: Fri Jul 27 06:59:50 2018 chromium-os-fuzzer: Re-add virglrenderer. virglrenderer can be built now with these CLs under review. CQ-DEPEND=CL:1151717,CL:1151537 BUG= chromium:867022 TEST=virglrenderer builds. Change-Id: I9584c6f8bcbd282ddb811c235187989aef1cbe03 Reviewed-on: https://chromium-review.googlesource.com/1152161 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Pohsien Wang <pwang@chromium.org> [modify] https://crrev.com/4505a078b2a45036cf97227a5c15d748d028f945/virtual/chromium-os-fuzzers/chromium-os-fuzzers-1.ebuild [rename] https://crrev.com/4505a078b2a45036cf97227a5c15d748d028f945/virtual/chromium-os-fuzzers/chromium-os-fuzzers-1-r8.ebuild
,
Jul 27
Tried to run the fuzzer but got this error: INFO: -max_len is not provided; libFuzzer will not generate inputs larger than 4096 bytes Couldn't open libEGL.so.1: libEGL.so.1: cannot open shared object file: No such file or directory Root cause is mesa files are not installed in sysroot.
,
Jul 28
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/54f3a82b76196ecab51e433ff75e4639c15476ae commit 54f3a82b76196ecab51e433ff75e4639c15476ae Author: Manoj Gupta <manojgupta@google.com> Date: Sat Jul 28 05:33:20 2018 virglrenderer: Fix building with fuzzer flag. Mesa libraries need to installed for the fuzzer to work. Fix this by adding mesa with gbm use to RDEPEND. Generated sysroot is curretnly missing mesa libraries: gs://chromeos-fuzzing-artifacts/libfuzzer-asan/amd64-generic-fuzzer/\ R70-10916.0.0-b2788847/sysroot_virtual_target-os.tar.xz BUG= chromium:867022 TEST=ASAN_OPTIONS="log_path=stderr" /usr/libexec/fuzzers/virgl_fuzzer works. Change-Id: Id5ba95747ba7edf9d654b2c75728c744b46a60b1 Reviewed-on: https://chromium-review.googlesource.com/1153609 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Pohsien Wang <pwang@chromium.org> [modify] https://crrev.com/54f3a82b76196ecab51e433ff75e4639c15476ae/media-libs/virglrenderer/virglrenderer-9999.ebuild [add] https://crrev.com/54f3a82b76196ecab51e433ff75e4639c15476ae/media-libs/virglrenderer/virglrenderer-0.6.0_p20180727-r1.ebuild [modify] https://crrev.com/54f3a82b76196ecab51e433ff75e4639c15476ae/media-libs/virglrenderer/virglrenderer-0.6.0_p20180727.ebuild
,
Jul 28
,
Jan 20
(3 days ago)
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/board-overlays/+/52058bf85cfb2d9f00b7ef78c243edd6ecdda3bb commit 52058bf85cfb2d9f00b7ef78c243edd6ecdda3bb Author: Manoj Gupta <manojgupta@google.com> Date: Sun Jan 20 01:30:05 2019 amd64-generic: Drop gbm use from mesa. gbm use flag is not needed with switching virglrenderer to minigbm. BUG= chromium:867022 TEST=virglrenderer builds in fuzzer builds. CQ-DEPEND=CL:1422538 Change-Id: Id59065345d7440780d501e2ca749f3bce04b784c Reviewed-on: https://chromium-review.googlesource.com/1422539 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: Mike Frysinger <vapier@chromium.org> [delete] https://crrev.com/cc9c26d5228320b10adc6401dc71b80460224242/overlay-amd64-generic/profiles/fuzzer/package.use [delete] https://crrev.com/cc9c26d5228320b10adc6401dc71b80460224242/overlay-amd64-generic/profiles/ubsan-fuzzer/package.use
,
Jan 20
(3 days ago)
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/e74bc3ef6a3a677340e0e9ceb4ef49abc543535f commit e74bc3ef6a3a677340e0e9ceb4ef49abc543535f Author: Manoj Gupta <manojgupta@google.com> Date: Sun Jan 20 01:30:05 2019 virglrenderer: Switch to minibgm for fuzzer builds. ChromeOS is using media-libs/minigbm instead of mesa's gbm. So switch to media-libs/minigbm for fuzzer builds as well. BUG= chromium:867022 TEST=virglrenderer builds in fuzzer builds. CQ-DEPEND=CL:1422539 Change-Id: Icb4a18ee104d8197c9fb31fbee3f8756b5487ae7 Reviewed-on: https://chromium-review.googlesource.com/1422538 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org> [modify] https://crrev.com/e74bc3ef6a3a677340e0e9ceb4ef49abc543535f/media-libs/virglrenderer/virglrenderer-9999.ebuild [modify] https://crrev.com/e74bc3ef6a3a677340e0e9ceb4ef49abc543535f/media-libs/virglrenderer/virglrenderer-0.7.0_p20190117.ebuild [rename] https://crrev.com/e74bc3ef6a3a677340e0e9ceb4ef49abc543535f/media-libs/virglrenderer/virglrenderer-0.7.0_p20190117-r2.ebuild |
|||||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||||
Comment 1 by manojgupta@chromium.org
, Jul 24