Issue metadata
Sign in to add a comment
|
Chromiumos-sdk builder failing in InitSDK stage. |
||||||||||||||||||||||||
Issue description
Sometime between 3am and 11pm on Dec. 17 a change went in that has caused the Chromeiumos-sdk builder to start failing quite earlyin the InitSDK stage.
The error is:
* IMPORTANT: config file '/etc/hosts' needs updating.
* See the CONFIGURATION FILES section of the emerge
* man page to learn how to update config files.
INFO cros_sdk:make_chroot: Updating preinstalled build tools
Traceback (most recent call last):
File "/mnt/host/source/chromite/bin/parallel_emerge", line 77, in <module>
from chromite.lib import commandline
File "/mnt/host/source/chromite/bin/parallel_emerge", line 69, in load_module
return __import__(mod)
File "/mnt/host/source/chromite/__init__.py", line 9, in <module>
import pkg_resources
ImportError: No module named pkg_resources
Running ['/b/swarming/w/ir/cache/cbuild/repository/src/scripts/sdk_lib/make_chroot.sh', '--stage3_path', '/b/swarming/w/ir/cache/cbuild/repository/.cache/sdks/stage3-amd64-2014.09.18.tar.xz', '--chroot', '/b/swarming/w/ir/cache/cbuild/repository/chroot', '--cache_dir', '/b/swarming/w/ir/cache/cbuild/repository/.cache', '--nousepkg'] failed!
[1;31m23:28:52: ERROR:
return code: 1; command: /b/swarming/w/ir/cache/cbuild/repository/chromite/bin/cros_sdk --buildbot-log-version --bootstrap --replace '--chrome_root=/b/swarming/w/ir/cache/cbuild/repository/.cache/distfiles/target-master/chrome-src'
cmd=['/b/swarming/w/ir/cache/cbuild/repository/chromite/bin/cros_sdk', '--buildbot-log-version', '--bootstrap', '--replace', '--chrome_root=/b/swarming/w/ir/cache/cbuild/repository/.cache/distfiles/target-master/chrome-src'], cwd=/b/swarming/w/ir/cache/cbuild/repository, extra env={'FEATURES': 'separatedebug', 'CHROME_ORIGIN': 'LOCAL_SOURCE'}[0m
[1;31m23:28:52: ERROR: /b/swarming/w/ir/cache/cbuild/repository/chromite/bin/cros_sdk failed (code=1)[0m
23:28:52: INFO: Translating result /b/swarming/w/ir/cache/cbuild/repository/chromite/bin/cros_sdk failed (code=1) to fail.
An example complete log is here:
https://luci-logdog.appspot.com/logs/chromeos/buildbucket/cr-buildbucket.appspot.com/8926820995524668416/+/steps/InitSDK/0/stdout
This needs to be fixed ASAP.
,
Dec 18
This can happen if setuptools disappears. Maybe the system python changed?
,
Dec 18
we've seen this of late when a package was updated using EAPI=6 that needs EAPI=5 to be bootstrapped. so the first place to look is the CLs that landed in portage-stable between the run before this failure started to see if any jump out as moving from 5 to 6.
,
Dec 18
EAPI=6 change here: crrev.com/c/1379495
,
Dec 18
in that case, pyblake2 is a new package that didn't previously exist and no one depends on currently, so it shouldn't cause bootstrap issues
,
Dec 18
Pretty sure that this is caused by https://chromium-review.googlesource.com/c/chromiumos/overlays/chromiumos-overlay/+/1380772 It removes sqlite-3.6.22-r3.ebuild which was previously built early in InitSDk stage. InitSDK log from a previously successful SDK run which builds sqlite-3.6.22-r3: https://luci-logdog.appspot.com/logs/chromeos/buildbucket/cr-buildbucket.appspot.com/8926897904384009920/+/steps/InitSDK/0/stdout !!! Section 'gentoo' in repos.conf has location attribute set to nonexistent directory: '/usr/portage' !!! Invalid Repository Location (not a dir): '/usr/portage' >>> Jobs: 0 of 8 complete, 1 running Load avg: 2.11, 4.60, 5.32 >>> Emerging (1 of 8) sys-devel/automake-wrapper-10 from portage-stable >>> Jobs: 0 of 8 complete, 1 running Load avg: 2.11, 4.60, 5.32 >>> Installing (1 of 8) sys-devel/automake-wrapper-10 >>> Jobs: 0 of 8 complete, 1 running Load avg: 2.10, 4.55, 5.31 >>> Jobs: 0 of 8 complete Load avg: 2.10, 4.55, 5.31 >>> Jobs: 1 of 8 complete Load avg: 2.10, 4.55, 5.31 >>> Jobs: 1 of 8 complete, 1 running Load avg: 2.10, 4.55, 5.31 >>> Emerging (2 of 8) sys-libs/ncurses-5.9-r7 from portage-stable >>> Jobs: 1 of 8 complete, 1 running Load avg: 2.10, 4.55, 5.31 >>> Installing (2 of 8) sys-libs/ncurses-5.9-r7 >>> Jobs: 1 of 8 complete, 1 running Load avg: 2.75, 4.37, 5.21 >>> Jobs: 1 of 8 complete Load avg: 2.75, 4.37, 5.21 >>> Jobs: 2 of 8 complete Load avg: 2.53, 4.30, 5.18 >>> Uninstalling sys-libs/ncurses-5.9-r3 >>> Jobs: 2 of 8 complete Load avg: 2.53, 4.30, 5.18 >>> Jobs: 2 of 8 complete, 1 running Load avg: 2.53, 4.30, 5.18 >>> Emerging (3 of 8) sys-devel/automake-1.15.1-r2 from portage-stable >>> Jobs: 2 of 8 complete, 1 running Load avg: 2.53, 4.30, 5.18 >>> Installing (3 of 8) sys-devel/automake-1.15.1-r2 >>> Jobs: 2 of 8 complete, 1 running Load avg: 2.22, 4.17, 5.13 >>> Jobs: 2 of 8 complete Load avg: 2.22, 4.17, 5.13 >>> Jobs: 3 of 8 complete Load avg: 2.22, 4.17, 5.13 >>> Jobs: 3 of 8 complete, 1 running Load avg: 2.22, 4.17, 5.13 >>> Emerging (4 of 8) dev-db/sqlite-3.6.22-r3 from chromiumos >>> Jobs: 3 of 8 complete, 1 running Load avg: 2.22, 4.17, 5.13 >>> Installing (4 of 8) dev-db/sqlite-3.6.22-r3 >>> Jobs: 3 of 8 complete, 1 running Load avg: 1.89, 3.84, 4.97 >>> Jobs: 3 of 8 complete Load avg: 1.89, 3.84, 4.97 >>> Jobs: 4 of 8 complete Load avg: 1.89, 3.84, 4.97 >>> Jobs: 4 of 8 complete, 1 running Load avg: 1.89, 3.84, 4.97
,
Dec 18
The sqlite ebuild left after the ebuild deletion has EAPI=6 which probably explains the breakage.
,
Dec 18
That makes sense I can test a downgrade of that package to EAPI=5 and if it works I will upload the change.
,
Dec 18
,
Dec 18
looks like Allen implemented the CL before i could
,
Dec 18
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/portage-stable/+/732ab777b27c6d8623dc885400a8b1eff1ab709e commit 732ab777b27c6d8623dc885400a8b1eff1ab709e Author: Allen Webb <allenwebb@google.com> Date: Tue Dec 18 22:04:11 2018 sqlite: Downgrade to EAPI=5 to fix crbug.com/916172 Init-SDK requires EAPI 5 or earlier. CL:1380772 removed an ebuild that was filling this need. BUG= chromium:916172 TEST=InitSDK works Change-Id: Ic93f34fbfcd01a409ea32290aba1c76635232de0 Reviewed-on: https://chromium-review.googlesource.com/c/1382616 Tested-by: Allen Webb <allenwebb@google.com> Trybot-Ready: Allen Webb <allenwebb@google.com> Reviewed-by: Mike Frysinger <vapier@chromium.org> Commit-Queue: Allen Webb <allenwebb@google.com> [rename] https://crrev.com/732ab777b27c6d8623dc885400a8b1eff1ab709e/dev-db/sqlite/sqlite-3.23.1-r1.ebuild
,
Dec 19
The chromiumos-sdk builder made it past the InitSDK stage. Marking this fixed.
,
Dec 19
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/portage-stable/+/93ebbe204d38e1043216114a8ef311bbe868456e commit 93ebbe204d38e1043216114a8ef311bbe868456e Author: Allen Webb <allenwebb@google.com> Date: Wed Dec 19 05:33:30 2018 pyblake2: Downgrade to EAPI=5 as potential fix to crbug.com/916172 . This isn't likely to fix the bug, but this needs to be downgraded anyway to uprev the portage ebuild later. BUG= chromium:916172 TEST=InitSDK works Change-Id: Iac31036bb21c66b86575a5252a46bb4941f61eaa Reviewed-on: https://chromium-review.googlesource.com/1382615 Commit-Ready: Allen Webb <allenwebb@google.com> Tested-by: Allen Webb <allenwebb@google.com> Reviewed-by: Mike Frysinger <vapier@chromium.org> [rename] https://crrev.com/93ebbe204d38e1043216114a8ef311bbe868456e/dev-python/pyblake2/pyblake2-1.1.2-r1.ebuild |
|||||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||||
Comment 1 by jclinton@chromium.org
, Dec 18Components: -Infra>Client>ChromeOS>CI Infra>Client>ChromeOS>Build
Status: Available (was: Untriaged)