psmisc manifest failure |
||||
Issue description"./build_packages --board=pyro" with a fresh "repo init" was failing for me yesterday while SourceForge's servers were down. There seems to be some problem with the size of https://commondatastorage.googleapis.com/chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz: $ emerge-pyro psmisc Calculating dependencies... done! >>> Emerging (1 of 1) sys-process/psmisc-22.21-r3::portage-stable for /build/pyro/ !!! SELinux module not found. Please verify that it was installed. !!! SELinux module not found. Please verify that it was installed. >>> Downloading 'https://commondatastorage.googleapis.com/chromeos-localmirror/distfiles/psmisc-22.21.tar.gz' % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (22) The requested URL returned error: 404 Not Found >>> Downloading 'https://commondatastorage.googleapis.com/chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz' % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 441k 100 441k 0 0 1755k 0 --:--:-- --:--:-- --:--:-- 1757k !!! Fetched file: psmisc-22.21.tar.gz VERIFY FAILED! !!! Reason: Filesize does not match recorded size !!! Got: 451833 !!! Expected: 457702 Refetching... File renamed to '/var/cache/chromeos-cache/distfiles/target/psmisc-22.21.tar.gz._checksum_failure_.WIQQtu' >>> Downloading 'http://kent.dl.sourceforge.net/psmisc/psmisc-22.21.tar.gz' % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 293 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 462 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 337 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 446k 100 446k 0 0 342k 0 0:00:01 0:00:01 --:--:-- 984k * psmisc-22.21.tar.gz SHA256 SHA512 WHIRLPOOL size ;-) ... [ ok ]
,
Oct 3 2017
I guess the builders have been downloading the file from dl.sourceforge.net if their cache is empty? The file I download from dl.sourceforge.net today is 457702 bytes, matching the expected size. Is there some way to update chromeos-mirror to match?
,
Oct 3 2017
we were configuring emerge to only fetch from our mirrors, but it looks like there's a codepath where it falls back and hits sf.net which is not what we want ... we need to see if there are any branches that expect 451833 for psmisc and if not, revert the gentoo mirror back to 457702 by hand.
,
Oct 27 2017
I did a little git spelunking in the portage-stable repo, and it looks like there have only ever been three versions of sys-process/psmisc/Manifest checked in. None of them ever referred to the 451833 file. I don't see any version of sys-process/psmisc ever checked into chromiumos-overlay, either. Is that enough to manually clean up the bad files from the gentoo mirror, or is there more I should check for?
,
Oct 28 2017
yes, that's perfect. the default psmisc-22.21.tar.gz is now the 457702 one.
$ gsutil cp -a public-read gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz#1492562753350884 gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz
$ gsutil rm gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz#1492562753350884
$ gsutil rm gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz#1492637876836766
$ gsutil ls -la gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz
451833 2013-11-10T23:22:29Z gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz#1384125750031000 metageneration=1
457702 2017-10-28T05:21:21Z gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz#1509168081578947 metageneration=1
TOTAL: 2 objects, 909535 bytes (888.22 KiB)
$ gsutil cat gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz#1384125750031000 | md5sum
f73645dd5dabea7125573a197a879164 -
$ gsutil cat gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz#1509168081578947 | md5sum
935c0fd6eb208288262b385fa656f1bf -
$ gsutil cat gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz | md5sum
935c0fd6eb208288262b385fa656f1bf -
,
Jan 22 2018
,
Jan 23 2018
|
||||
►
Sign in to add a comment |
||||
Comment 1 by vapier@chromium.org
, Sep 28 2017Components: Infra>Client>ChromeOS
Labels: -Pri-3 OS-Chrome Pri-2
Summary: psmisc manifest failure (was: psmisc chromeos-mirror verify failed)
hrm looks like upstream messed around a bit $ gsutil ls -la gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz 451833 2013-11-10T23:22:29Z gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz#1384125750031000 metageneration=1 457702 2017-04-19T00:45:53Z gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz#1492562753350884 metageneration=1 451833 2017-04-19T21:37:56Z gs://chromeos-mirror/gentoo/distfiles/psmisc-22.21.tar.gz#1492637876836766 metageneration=1 TOTAL: 3 objects, 1361368 bytes (1.3 MiB) however, if this was an issue, it should have been failing everywhere ... have all our bots been running of caches for 5 months ? that seems unlikely.