Mac trybots running out of disk space. |
||||||||
Issue descriptionvm1026-m4 is at 90% disk capacity. It currently runs builds for: mac_chromium_archive_rel_ng mac_chromium_asan_rel_ng mac_chromium_asan_variable mac_chromium_compile_rel_ng mac_chromium_variable mac_chromium_variable_archive mac_chromium_variable_chrome mac_chromium_variable_gn mac_deterministic Maybe this needs to be split up?
,
Mar 28 2016
,
Mar 28 2016
Looks like http://crbug.com/595031
,
Mar 28 2016
Here's the breakdown before compacting some directories in cache_dir: chrome-bot@vm1026-m4 /b/build/slave$ du -ksc * 11493720 cache_dir 89442724 mac 18176732 mac_asan 15476128 mac_chromium_archive_rel_ng 28431084 mac_chromium_asan_rel_ng 6103640 mac_deterministic ... 169124352 total And after compacting cache_dir/chromium.googlesource.com-chromium-src only, we gained 2GB 8164248 cache_dir Disk usage is 89% now, solving the immediate issue.
,
Mar 28 2016
Reopening at dnj's request, because the problem is not permanently fixed.
,
Mar 28 2016
+phajdan.jr@, there are too many builders on this bot pool. We need to split it. Since you are an owner for tryserver.chromium.mac, can you determine a suitable way to do this?
,
Mar 30 2016
The alert is firing again on vm1026-m4. Moving that back to the trooper queue.
,
Mar 30 2016
Ran git gc in the largest git checkout in /b/build/slave/cache_dir/ but it just went from to 5.3G to 4.8G. So I deleted everything in cache_dir. df says 91% used. /b/build/slave/mac is huge though: 96G.
,
Mar 31 2016
96G is not a normal size. Have you looked into the directory?
,
Mar 31 2016
I will take care of that. +sean as the current trooper.
,
Mar 31 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/tools/build.git/+/6198936a868ef3bad0dd94b968cd267a192b5a72 commit 6198936a868ef3bad0dd94b968cd267a192b5a72 Author: pgervais@chromium.org <pgervais@chromium.org> Date: Thu Mar 31 22:59:30 2016 Reorganized optional builders on mac tryserver To better spread out disk usage. Probably won't be enough. BUG= 598374 Review URL: https://codereview.chromium.org/1851683002 git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@299606 0039d316-1c4b-4281-b951-d872f2087c98 [modify] https://crrev.com/6198936a868ef3bad0dd94b968cd267a192b5a72/masters/master.tryserver.chromium.mac/slaves.cfg
,
Apr 1 2016
,
Apr 26 2016
|
||||||||
►
Sign in to add a comment |
||||||||
Comment 1 by pgervais@chromium.org
, Mar 28 2016