install-build-deps.sh fails on GCE Ubuntu 14.4 LTS |
|||||||
Issue descriptionOn a GCE instance created with an Ubuntu 14.4 LTS image... if I try to install the required build packages, a lot of extra stuff is pulled in, including all of X11. This is currently causing problems for me because X11 pulls in ttf-mscorefonts-installer, which requires debconf and an interactive prompt to accept the license. I'm trying to update the script that sets up the GCE image. This feels like we are accidentally pulling in a lot more package dependencies than we need. 17:56:56: INFO: RunCommand: git clone https://chromium.googlesource.com/chromium/src/build in /tmp/tmp-chrome-depsYhFTSf Cloning into 'build'... 17:57:01: INFO: RunCommand: /tmp/tmp-chrome-depsYhFTSf/build/install-build-deps.sh --syms --no-prompt Running as non-root user. You might have to enter your password one or more times for 'sudo'. Including debugging symbols. Including 32-bit libraries for ARM/Android. Including ARM cross toolchain. Including NaCl, NaCl toolchain, NaCl ports dependencies. Ign http://us-east1-a.gce.clouds.archive.ubuntu.com trusty InRelease Ign http://archive.canonical.com trusty InRelease Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates InRelease Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports InRelease Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty Release.gpg Hit http://archive.canonical.com trusty Release.gpg Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/main Sources Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/restricted Sources Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/universe Sources Hit http://archive.canonical.com trusty Release Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/multiverse Sources Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/main amd64 Packages Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/restricted amd64 Packages Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/universe amd64 Packages Hit http://archive.canonical.com trusty/partner amd64 Packages Hit http://security.ubuntu.com trusty-security InRelease Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/multiverse amd64 Packages Get:1 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/main i386 Packages [710 kB] Get:2 http://archive.canonical.com trusty/partner i386 Packages [6,310 B] Hit http://security.ubuntu.com trusty-security/main Sources Hit http://archive.canonical.com trusty/partner Translation-en Hit http://security.ubuntu.com trusty-security/universe Sources Hit http://security.ubuntu.com trusty-security/main amd64 Packages Hit http://security.ubuntu.com trusty-security/universe amd64 Packages Get:3 http://security.ubuntu.com trusty-security/main i386 Packages [421 kB] Get:4 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/restricted i386 Packages [15.6 kB] Get:5 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/universe i386 Packages [357 kB] Get:6 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/multiverse i386 Packages [13.6 kB] Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/main Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/multiverse Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/restricted Translation-en Get:7 http://security.ubuntu.com trusty-security/universe i386 Packages [125 kB] Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-updates/universe Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/main Sources Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/restricted Sources Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/universe Sources Hit http://security.ubuntu.com trusty-security/main Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/multiverse Sources Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/main amd64 Packages Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/restricted amd64 Packages Hit http://security.ubuntu.com trusty-security/universe Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/universe amd64 Packages Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/multiverse amd64 Packages Get:8 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/main i386 Packages [9,797 B] Get:9 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/restricted i386 Packages [28 B] Get:10 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/universe i386 Packages [41.4 kB] Get:11 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/multiverse i386 Packages [1,552 B] Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/main Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/multiverse Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/restricted Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty-backports/universe Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty Release Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/main Sources Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/restricted Sources Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/universe Sources Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/multiverse Sources Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/main amd64 Packages Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/restricted amd64 Packages Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/universe amd64 Packages Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/multiverse amd64 Packages Get:12 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/main i386 Packages [1,348 kB] Get:13 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/restricted i386 Packages [13.4 kB] Get:14 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/universe i386 Packages [5,866 kB] Get:15 http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/multiverse i386 Packages [134 kB] Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/main Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/multiverse Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/restricted Translation-en Hit http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/universe Translation-en Ign http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/main Translation-en_US Ign http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/multiverse Translation-en_US Ign http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/restricted Translation-en_US Ign http://us-east1-a.gce.clouds.archive.ubuntu.com trusty/universe Translation-en_US Fetched 9,063 kB in 5s (1,645 kB/s) Reading package lists... Finding missing packages... Packages required: libasound2:i386 libcap2:i386 libelf-dev:i386 libfontconfig1:i386 libgconf-2-4:i386 libgl1-mesa-glx:i386 libglib2.0-0:i386 libgpm2:i386 libgtk2.0-0:i386 libncurses5:i386 libnss3:i386 libpango1.0-0:i386 libssl1.0.0:i386 libtinfo-dev:i386 libudev1:i386 libxcomposite1:i386 libxcursor1:i386 libxdamage1:i386 libxi6:i386 libxrandr2:i386 libxss1:i386 libxtst6:i386 linux-libc-dev:i386 ant apache2-bin autoconf bison cdbs cmake curl devscripts dpkg-dev elfutils fakeroot flex fonts-stix fonts-thai-tlwg g++ g++-4.8-multilib g++-4.8-multilib-arm-linux-gnueabihf g++-arm-linux-gnueabihf gawk gcc-4.8-multilib-arm-linux-gnueabihf git-core git-svn g++-mingw-w64-i686 gperf intltool language-pack-da language-pack-fr language-pack-he language-pack-zh-hant lib32gcc1 lib32ncurses5-dev lib32stdc++6 lib32z1-dev libapache2-mod-php5 libasound2 libasound2-dev libatk1.0-0 libatk1.0-dbg libav-tools libbluetooth-dev libbrlapi0.6 libbrlapi-dev libbz2-1.0 libbz2-dev libc6 libc6-dbg libc6-dev-armhf-cross libc6-i386 libcairo2 libcairo2-dbg libcairo2-dev libcap2 libcap-dev libcups2 libcups2-dev libcurl4-gnutls-dev libdrm-dev libelf-dev libexpat1 libffi6 libffi6-dbg libffi-dev libfontconfig1 libfontconfig1-dbg libfreetype6 libgbm-dev libgconf2-dev libgl1-mesa-dev libgles2-mesa-dev libglib2.0-0 libglib2.0-0-dbg libglib2.0-dev libglu1-mesa-dev libgnome-keyring0 libgnome-keyring-dev libgtk2.0-0 libgtk2.0-0-dbg libgtk2.0-dev libjpeg-dev libkrb5-dev libnspr4 libnspr4-dbg libnspr4-dev libnss3 libnss3-dbg libnss3-dev libpam0g libpam0g-dev libpango1.0-0 libpango1.0-0-dbg libpci3 libpci-dev libpcre3 libpcre3-dbg libpixman-1-0 libpixman-1-0-dbg libpng12-0 libpulse0 libpulse-dev libsctp-dev libspeechd2 libspeechd-dev libsqlite3-0 libsqlite3-0-dbg libsqlite3-dev libssl-dev libstdc++6 libstdc++6-4.8-dbg libtinfo-dev libtool libudev1 libudev-dev libwww-perl libx11-6 libx11-6-dbg libxau6 libxau6-dbg libxcb1 libxcb1-dbg libxcomposite1 libxcomposite1-dbg libxcursor1 libxcursor1-dbg libxdamage1 libxdamage1-dbg libxdmcp6 libxdmcp6-dbg libxext6 libxext6-dbg libxfixes3 libxfixes3-dbg libxi6 libxi6-dbg libxinerama1 libxinerama1-dbg libxkbcommon-dev libxrandr2 libxrandr2-dbg libxrender1 libxrender1-dbg libxslt1-dev libxss-dev libxt-dev libxtst6 libxtst6-dbg libxtst-dev linux-libc-dev-armhf-cross mesa-common-dev openbox patch perl php5-cgi pkg-config python python-cherrypy3 python-crypto python-dev python-numpy python-opencv python-openssl python-psutil python-yaml realpath rpm ruby subversion texinfo ttf-dejavu-core ttf-indic-fonts ttf-kochi-gothic ttf-kochi-mincho ttf-mscorefonts-installer wdiff xsltproc xutils-dev xvfb zip zlib1g zlib1g-dbg
,
Mar 24 2016
We have our own scripts for creating a GCE builder image, that have been around for a while, but the image hasn't been updated for about a year. There is an okr to integrate with ccompute next quarter, but I need a big pile of GCE instances quickly. So I'm trying to update our base image and use that for the moment. When we start putting together that ccompute plan, I hope to chat about how we manage them to reduce duplication with puppet.
,
Mar 24 2016
After resolving the EULA problems, install-build-deps.sh fails later on with this error:
Elliot, do you own that script?
Errors were encountered while processing:
/var/cache/apt/archives/libstdc++6-armhf-cross_4.8.4-2ubuntu1~14.04.1cross0.11.1_all.deb
E: Sub-process /usr/bin/dpkg returned an error code (1)
setup_bot: Unhandled exception:
Traceback (most recent call last):
File "/tmp/chromite/compute/setup_bot", line 164, in <module>
commandline.ScriptWrapperMain(FindTarget)
File "/tmp/chromite/lib/commandline.py", line 834, in ScriptWrapperMain
ret = target(argv[1:])
File "/tmp/chromite/compute/setup_bot.py", line 250, in main
InstallChromeDependencies()
File "/tmp/chromite/compute/setup_bot.py", line 93, in InstallChromeDependencies
'--syms', '--no-prompt'])
File "/tmp/chromite/lib/cros_build_lib.py", line 619, in RunCommand
raise RunCommandError(msg, cmd_result)
chromite.lib.cros_build_lib.RunCommandError: return code: 100; command: /tmp/tmp-chrome-deps6mB2Rf/build/install-build-deps.sh --syms --no-prompt
cwd=None
Trying to install that package by hand, it looks like something earlier in the build dependencies script force installed some packages earlier, which left the package dependency tree a mess.
,
Mar 24 2016
Rolling back to an older version of Ubuntu to see if that helps.
,
Mar 24 2016
Yes, it's what we use to setup every linux bot.
,
Mar 24 2016
I'm creating GCE instances based on Ubuntu 14.04 LTS, and finding that even after I strip out nearly everything else we do, 'install-build-deps.sh' fails. Is it expected to work on a non Goobuntu image?
,
Mar 25 2016
Yeah, it's meant to be run by open source devs publicly.
,
Mar 25 2016
I'm pretty sure X11 and ttf-mscorefonts-installer are installed on purpose. We even set debconfs to deal with installing those. echo "ttf-mscorefonts-installer msttcorefonts/accepted-mscorefonts-eula select true" | /usr/bin/debconf-set-selections echo "debconf debconf/frontend select Noninteractive" | /usr/bin/debconf-set-selections See https://chrome-internal.googlesource.com/infra/infra_internal/+/master/ccompute/images/scripts/expectations-trusty#52
,
Mar 26 2016
Trying to produce a minimal test case based on our image creation script, I did: 1) Create GCE instance based on Ubuntu 14.04 LTS 2) sudo apt-get update 3) sudo apt-get install realpath git 4) git clone https://chromium.googlesource.com/chromium/src/build 5) build/install-build-deps.sh --syms --no-prompt It popped up an interactive text UI to prompt me about accepting the fonts EULA. And eventually failed with: Processing triggers for shared-mime-info (1.2-0ubuntu3) ... Processing triggers for mime-support (3.54ubuntu1.1) ... Errors were encountered while processing: /var/cache/apt/archives/libstdc++6-armhf-cross_4.8.4-2ubuntu1~14.04.1cross0.11.1_all.deb E: Sub-process /usr/bin/dpkg returned an error code (1)
,
Mar 26 2016
Scrolling way back through the logs, I found: ... Unpacking gcc-arm-linux-gnueabihf (4:4.8.2-1) ... Selecting previously unselected package libstdc++6-armhf-cross. Preparing to unpack .../libstdc++6-armhf-cross_4.8.4-2ubuntu1~14.04.1cross0.11.1_all.deb ... Unpacking libstdc++6-armhf-cross (4.8.4-2ubuntu1~14.04.1cross0.11.1) ... dpkg: error processing archive /var/cache/apt/archives/libstdc++6-armhf-cross_4.8.4-2ubuntu1~14.04.1cross0.11.1_all.deb (--unpack): trying to overwrite '/usr/share/gcc-4.8/python/libstdcxx/__init__.py', which is also in package libstdc++6:i386 4.8.4-2ubuntu1~14.04.1 Selecting previously unselected package linux-libc-dev-armhf-cross. Preparing to unpack .../linux-libc-dev-armhf-cross_3.13.0-12.32cross1.104_all.deb ... Unpacking linux-libc-dev-armhf-cross (3.13.0-12.32cross1.104) ... ...
,
Mar 28 2016
,
Mar 28 2016
,
Apr 21 2016
,
Apr 21 2016
|
|||||||
►
Sign in to add a comment |
|||||||
Comment 1 by fried...@google.com
, Mar 24 2016