On occasion builds fail when GOB quota is exceeded. An example build failure of this kind:
https://uberchromegw.corp.google.com/i/chromeos/builders/orco-release/builds/169
In this particular case, the "SyncChrome" phase failed. Looking at the logs we see messages such as "remote: Short term bandwidth rate limit exceeded for 3su6n15k.default@developer.gserviceaccount.com". Such messages seem to be a clear indication of build failures caused by hitting GOB quota limits.
Request here is to look for such messages in the logs and if found annotate the build stage where such errors occurred with a clear message such as "GOB quota exceeded, ping your friendly build deputies". This should help make sheriffs more efficient.
Aviv, Chris, would this be a well contained small enough a issue for someone on our team to pick up to get more familiarity with the tooling? If you folks have cycles to pick it up, that works great too.
Comment 1 by snanda@chromium.org
, Jul 1 2016