Flaky ensure xcode.install xcode on ios-simulator |
||||
Issue descriptionSaw this in 6 out of last 200 builds: https://ci.chromium.org/buildbot/tryserver.chromium.mac/ios-simulator/408690 https://ci.chromium.org/buildbot/tryserver.chromium.mac/ios-simulator/408647 https://ci.chromium.org/buildbot/tryserver.chromium.mac/ios-simulator/408625 https://ci.chromium.org/buildbot/tryserver.chromium.mac/ios-simulator/408616 https://ci.chromium.org/buildbot/tryserver.chromium.mac/ios-simulator/408590 https://ci.chromium.org/buildbot/tryserver.chromium.mac/ios-simulator/408561 Personally encountered this in https://ci.chromium.org/buildbot/tryserver.chromium.mac/ios-simulator/407554, log from there: [P14628 08:00:43.220 client.go:1431 E] Failed to install infra_internal/ios/xcode/ios:7aa71b9294be8d313766344aa7ce83c53a371872 - write /b/build/slave/cache/xcode_ios_9c40b.app/.cipd/pkgs/1/Zhtpf2y6MrDO/x/Contents/Developer/Platforms/iPhoneOS.platform/Developer/Library/CoreSimulator/Profiles/Runtimes/iOS.simruntime/Contents/Resources/RuntimeRoot/System/Library/PrivateFrameworks/iTunesStore.framework/iTunesStore: no space left on device Error: failed to update packages, see the log. [E 2018-03-05 08:00:43] original error: exit status 1 [E 2018-03-05 08:00:43] [E 2018-03-05 08:00:43] goroutine 1: [E 2018-03-05 08:00:43] #0 mac_toolchain/install.go:40 - main.installPackages() [E 2018-03-05 08:00:43] reason: failed to install CIPD packages: infra_internal/ios/xcode/mac 9c40b [E 2018-03-05 08:00:43] infra_internal/ios/xcode/ios 9c40b [E 2018-03-05 08:00:43] [E 2018-03-05 08:00:43] [E 2018-03-05 08:00:43] #1 mac_toolchain/install.go:152 - main.installXcode() [E 2018-03-05 08:00:43] #2 mac_toolchain/main.go:115 - main.(*installRun).Run() [E 2018-03-05 08:00:43] #3 github.com/maruel/subcommands/subcommands.go:360 - subcommands.Run() [E 2018-03-05 08:00:43] #4 mac_toolchain/main.go:239 - main.main() [E 2018-03-05 08:00:43] #5 runtime/proc.go:185 - runtime.main() [E 2018-03-05 08:00:43] #6 runtime/asm_amd64.s:2337 - runtime.goexit() step returned non-zero exit code: 1 Sergey, looks like you are familiar with this, could you please triage?
,
Mar 7 2018
Hmm, that's an odd error. I'll look into it.
,
Mar 7 2018
Oh, the machine ran out of disk space! All the flakes are on vm806-m4. Let's see what's eating up the space...
,
Mar 7 2018
chrome-bot@vm806-m4:(Mac 10.12.6):/b/build/slave$ du -sch * 35G cache_dir 69G ios-simulator 104G total chrome-bot@vm806-m4:(Mac 10.12.6):/b/build/slave$ du -sch cache_dir/* | sort -n 21G cache_dir/chrome--internal.googlesource.com-chrome-deps-adobe-flash-symbols-ppapi-mac_64 ... 35G total chrome-bot@vm806-m4:(Mac 10.12.6):/b/build/slave$ du -sch ios-simulator/build/src/out/Debug-iphonesimulator/* | sort -n 17G ios-simulator/build/src/out/Debug-iphonesimulator/ios_clang_x86 29G ios-simulator/build/src/out/Debug-iphonesimulator/obj ... 57G total
,
Mar 7 2018
I'm going to kill the largest entry in cache_dir and out/Debug-iphonesimulator. The latter will likely rebuild to about the same size (I don't see anything suspicious there). The cache, hopefully, won't need such a massive entry... A 21G git repo? Seriously?..
,
Mar 7 2018
$ df -h . Filesystem Size Used Avail Capacity iused ifree %iused Mounted on /dev/disk0s2 199Gi 115Gi 84Gi 58% 2749846 4292217433 0% / This should give it some breathing room.
,
Mar 7 2018
The first build is through the "ensure xcode" step: https://ci.chromium.org/buildbot/tryserver.chromium.mac/ios-simulator/409393
,
Mar 7 2018
...and now it fails because analyze thinks compile isn't necessary, but the isolate step insists on isolating something from out/Debug-iphonesimulator which I deleted... D'oh! |
||||
►
Sign in to add a comment |
||||
Comment 1 by vadimsh@chromium.org
, Mar 7 2018