New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 739933 link

Starred by 5 users

Issue metadata

Status: Fixed
Owner:
Closed: Jul 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: All
Pri: 0
Type: Bug



Sign in to add a comment

Lots of builds failing with goma errors

Project Member Reported by dpranke@chromium.org, Jul 6 2017

Issue description

Lots of builds are failing w/ various goma errors. This appears to be due to a Google-wide outage in some of the services we depend on (various Apiary issues, see omg/5588.
 
Description: Show this description
It looks like the outage is mostly over, and error rates are in the vicinity of normal. 

I'm going to leave this open for a while longer to keep an eye on things.
Also see http://o/408946 . There's not much we can talk about here, unfortunately.
Issue 739951 has been merged into this issue.
I think we're continuing to see a large number of failing builds as builds that started during the outage hit various points (like the package_build step) that might've been affected by the outage. It may take another few hours to get everything through the queue.
Cc: xixuan@chromium.org derat@chromium.org uekawa@chromium.org akes...@chromium.org x...@chromium.org kkunduru@chromium.org hidehiko@chromium.org
 Issue 739943  has been merged into this issue.
 Issue 739936  has been merged into this issue.
Labels: Sheriff-Chromium
Labels: -Sheriff-Chromium
No recent build failures, removing from sheriff queue.
Status: Fixed (was: Started)
Labels: cit-pm-56 OS-All
I've filed bugs 740307 and 740308 for follow-up actions.

Sign in to add a comment