New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 625266 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Jul 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

Clarify GOB quota limit exceeded message on waterfall

Project Member Reported by snanda@chromium.org, Jul 1 2016

Issue description

On occasion builds fail when GOB quota is exceeded.  An example build failure of this kind:
https://uberchromegw.corp.google.com/i/chromeos/builders/orco-release/builds/169

In this particular case, the "SyncChrome" phase failed.  Looking at the logs we see messages such as "remote: Short term bandwidth rate limit exceeded for 3su6n15k.default@developer.gserviceaccount.com".  Such messages seem to be a clear indication of build failures caused by hitting GOB quota limits.

Request here is to look for such messages in the logs and if found annotate the build stage where such errors occurred with a clear message such as "GOB quota exceeded, ping your friendly build deputies".  This should help make sheriffs more efficient.

Aviv, Chris, would this be a well contained small enough a issue for someone on our team to pick up to get more familiarity with the tooling?  If you folks have cycles to pick it up, that works great too.
 
Cc: keta...@chromium.org
Status: WontFix (was: Untriaged)
Richard tells us that this symptom has only been seen twice ever. In both instances it was caused by changes infra folks made and they were monitoring for fallout.

Not worth spending more effort here in that case.  Closing.

Sign in to add a comment