New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 916172 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Dec 19
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug
Build-Toolchain



Sign in to add a comment

Chromiumos-sdk builder failing in InitSDK stage.

Project Member Reported by cmt...@chromium.org, Dec 18

Issue description

Sometime between 3am and 11pm on Dec. 17 a change went in that has caused the Chromeiumos-sdk builder to start failing quite earlyin the InitSDK stage.

The error is:



 * IMPORTANT: config file '/etc/hosts' needs updating.
 * See the CONFIGURATION FILES section of the emerge
 * man page to learn how to update config files.
INFO    cros_sdk:make_chroot: Updating preinstalled build tools
Traceback (most recent call last):
  File "/mnt/host/source/chromite/bin/parallel_emerge", line 77, in <module>
    from chromite.lib import commandline
  File "/mnt/host/source/chromite/bin/parallel_emerge", line 69, in load_module
    return __import__(mod)
  File "/mnt/host/source/chromite/__init__.py", line 9, in <module>
    import pkg_resources
ImportError: No module named pkg_resources
Running ['/b/swarming/w/ir/cache/cbuild/repository/src/scripts/sdk_lib/make_chroot.sh', '--stage3_path', '/b/swarming/w/ir/cache/cbuild/repository/.cache/sdks/stage3-amd64-2014.09.18.tar.xz', '--chroot', '/b/swarming/w/ir/cache/cbuild/repository/chroot', '--cache_dir', '/b/swarming/w/ir/cache/cbuild/repository/.cache', '--nousepkg'] failed!
23:28:52: ERROR: 
return code: 1; command: /b/swarming/w/ir/cache/cbuild/repository/chromite/bin/cros_sdk --buildbot-log-version --bootstrap --replace '--chrome_root=/b/swarming/w/ir/cache/cbuild/repository/.cache/distfiles/target-master/chrome-src'
cmd=['/b/swarming/w/ir/cache/cbuild/repository/chromite/bin/cros_sdk', '--buildbot-log-version', '--bootstrap', '--replace', '--chrome_root=/b/swarming/w/ir/cache/cbuild/repository/.cache/distfiles/target-master/chrome-src'], cwd=/b/swarming/w/ir/cache/cbuild/repository, extra env={'FEATURES': 'separatedebug', 'CHROME_ORIGIN': 'LOCAL_SOURCE'}

23:28:52: ERROR: /b/swarming/w/ir/cache/cbuild/repository/chromite/bin/cros_sdk failed (code=1)
23:28:52: INFO: Translating result /b/swarming/w/ir/cache/cbuild/repository/chromite/bin/cros_sdk failed (code=1) to fail.


An example complete log is here:
https://luci-logdog.appspot.com/logs/chromeos/buildbucket/cr-buildbucket.appspot.com/8926820995524668416/+/steps/InitSDK/0/stdout

This needs to be fixed ASAP.

 
Cc: vapier@chromium.org shapiroc@chromium.org nednguyen@chromium.org
Components: -Infra>Client>ChromeOS>CI Infra>Client>ChromeOS>Build
Status: Available (was: Untriaged)
Over to Build team to find an owner.
This can happen if setuptools disappears. Maybe the system python changed?
we've seen this of late when a package was updated using EAPI=6 that needs EAPI=5 to be bootstrapped.  so the first place to look is the CLs that landed in portage-stable between the run before this failure started to see if any jump out as moving from 5 to 6.
EAPI=6 change here: crrev.com/c/1379495
in that case, pyblake2 is a new package that didn't previously exist and no one depends on currently, so it shouldn't cause bootstrap issues
Owner: vapier@chromium.org
Status: Assigned (was: Available)
Pretty sure that this is caused by https://chromium-review.googlesource.com/c/chromiumos/overlays/chromiumos-overlay/+/1380772

It removes sqlite-3.6.22-r3.ebuild  which was previously built early in InitSDk stage.

InitSDK log from a previously successful SDK run which builds sqlite-3.6.22-r3:
https://luci-logdog.appspot.com/logs/chromeos/buildbucket/cr-buildbucket.appspot.com/8926897904384009920/+/steps/InitSDK/0/stdout

!!! Section 'gentoo' in repos.conf has location attribute set to nonexistent directory: '/usr/portage'
!!! Invalid Repository Location (not a dir): '/usr/portage'
>>> Jobs: 0 of 8 complete, 1 running                Load avg: 2.11, 4.60, 5.32
>>> Emerging (1 of 8) sys-devel/automake-wrapper-10 from portage-stable
>>> Jobs: 0 of 8 complete, 1 running                Load avg: 2.11, 4.60, 5.32
>>> Installing (1 of 8) sys-devel/automake-wrapper-10
>>> Jobs: 0 of 8 complete, 1 running                Load avg: 2.10, 4.55, 5.31
>>> Jobs: 0 of 8 complete                           Load avg: 2.10, 4.55, 5.31
>>> Jobs: 1 of 8 complete                           Load avg: 2.10, 4.55, 5.31
>>> Jobs: 1 of 8 complete, 1 running                Load avg: 2.10, 4.55, 5.31
>>> Emerging (2 of 8) sys-libs/ncurses-5.9-r7 from portage-stable
>>> Jobs: 1 of 8 complete, 1 running                Load avg: 2.10, 4.55, 5.31
>>> Installing (2 of 8) sys-libs/ncurses-5.9-r7
>>> Jobs: 1 of 8 complete, 1 running                Load avg: 2.75, 4.37, 5.21
>>> Jobs: 1 of 8 complete                           Load avg: 2.75, 4.37, 5.21
>>> Jobs: 2 of 8 complete                           Load avg: 2.53, 4.30, 5.18
>>> Uninstalling sys-libs/ncurses-5.9-r3
>>> Jobs: 2 of 8 complete                           Load avg: 2.53, 4.30, 5.18
>>> Jobs: 2 of 8 complete, 1 running                Load avg: 2.53, 4.30, 5.18
>>> Emerging (3 of 8) sys-devel/automake-1.15.1-r2 from portage-stable
>>> Jobs: 2 of 8 complete, 1 running                Load avg: 2.53, 4.30, 5.18
>>> Installing (3 of 8) sys-devel/automake-1.15.1-r2
>>> Jobs: 2 of 8 complete, 1 running                Load avg: 2.22, 4.17, 5.13
>>> Jobs: 2 of 8 complete                           Load avg: 2.22, 4.17, 5.13
>>> Jobs: 3 of 8 complete                           Load avg: 2.22, 4.17, 5.13
>>> Jobs: 3 of 8 complete, 1 running                Load avg: 2.22, 4.17, 5.13
>>> Emerging (4 of 8) dev-db/sqlite-3.6.22-r3 from chromiumos
>>> Jobs: 3 of 8 complete, 1 running                Load avg: 2.22, 4.17, 5.13
>>> Installing (4 of 8) dev-db/sqlite-3.6.22-r3
>>> Jobs: 3 of 8 complete, 1 running                Load avg: 1.89, 3.84, 4.97
>>> Jobs: 3 of 8 complete                           Load avg: 1.89, 3.84, 4.97
>>> Jobs: 4 of 8 complete                           Load avg: 1.89, 3.84, 4.97
>>> Jobs: 4 of 8 complete, 1 running                Load avg: 1.89, 3.84, 4.97
The sqlite ebuild left after the ebuild deletion has EAPI=6 which probably explains the breakage.
That makes sense I can test a downgrade of that package to EAPI=5 and if it works I will upload the change.
Cc: allenwebb@google.com
Cc: -shapiroc@chromium.org -allenwebb@google.com allenwebb@chromium.org
Owner: allenwebb@chromium.org
looks like Allen implemented the CL before i could
Project Member

Comment 11 by bugdroid1@chromium.org, Dec 18

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/portage-stable/+/732ab777b27c6d8623dc885400a8b1eff1ab709e

commit 732ab777b27c6d8623dc885400a8b1eff1ab709e
Author: Allen Webb <allenwebb@google.com>
Date: Tue Dec 18 22:04:11 2018

sqlite: Downgrade to EAPI=5 to fix  crbug.com/916172 

Init-SDK requires EAPI 5 or earlier. CL:1380772 removed an ebuild that
was filling this need.

BUG= chromium:916172 
TEST=InitSDK works

Change-Id: Ic93f34fbfcd01a409ea32290aba1c76635232de0
Reviewed-on: https://chromium-review.googlesource.com/c/1382616
Tested-by: Allen Webb <allenwebb@google.com>
Trybot-Ready: Allen Webb <allenwebb@google.com>
Reviewed-by: Mike Frysinger <vapier@chromium.org>
Commit-Queue: Allen Webb <allenwebb@google.com>

[rename] https://crrev.com/732ab777b27c6d8623dc885400a8b1eff1ab709e/dev-db/sqlite/sqlite-3.23.1-r1.ebuild

Status: Fixed (was: Assigned)
The chromiumos-sdk builder made it past the InitSDK stage. Marking this fixed.
Project Member

Comment 13 by bugdroid1@chromium.org, Dec 19

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/portage-stable/+/93ebbe204d38e1043216114a8ef311bbe868456e

commit 93ebbe204d38e1043216114a8ef311bbe868456e
Author: Allen Webb <allenwebb@google.com>
Date: Wed Dec 19 05:33:30 2018

pyblake2: Downgrade to EAPI=5 as potential fix to  crbug.com/916172 .

This isn't likely to fix the bug, but this needs to be downgraded anyway
to uprev the portage ebuild later.

BUG= chromium:916172 
TEST=InitSDK works

Change-Id: Iac31036bb21c66b86575a5252a46bb4941f61eaa
Reviewed-on: https://chromium-review.googlesource.com/1382615
Commit-Ready: Allen Webb <allenwebb@google.com>
Tested-by: Allen Webb <allenwebb@google.com>
Reviewed-by: Mike Frysinger <vapier@chromium.org>

[rename] https://crrev.com/93ebbe204d38e1043216114a8ef311bbe868456e/dev-python/pyblake2/pyblake2-1.1.2-r1.ebuild

Sign in to add a comment