New issue
Advanced search Search tips

Issue 732859 link

Starred by 7 users

Issue metadata

Status: Fixed
Owner:
Closed: Jun 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 0
Type: ----



Sign in to add a comment

All waterfalls are down

Reported by jrbarnette@chromium.org, Jun 13 2017

Issue description

These URLs:
    https://uberchromegw.corp.google.com/i/chromeos/waterfall
    https://build.chromium.org/p/chromiumos/waterfall

Return this text, and nothing else:
    Http/1.1 Service Unavailable

 

Comment 1 by wfh@chromium.org, Jun 13 2017

Cc: wfh@chromium.org
also crbug.com

Labels: -Restrict-View-Google
Owner: vadimsh@chromium.org
Status: Assigned (was: Untriaged)
Summary: All waterfalls are down (was: Chrome OS waterfalls are down)
Yep... Looking into it. Removing RVG and promoting this bug to the main tracking bug for the outage.
Components: Infra>Labs
Labs team are still looking. So far it appears to be intermittent network-related issue in Golo datacenter (where all our Buildbot masters are).

It seems everything is back online currently, but we are not sure yet what was the root cause of the outage, and so can't tell for certain that the problems are over.
Status: Fixed (was: Assigned)
Cautiously closing this incident as over.

We don't yet know for sure what happened and why, but Chrome Labs team have some ideas. The investigation will continue in internal bugs (since the outage is related to the internal golo infrastructure).

This bug will be reopened if we notice problems reappearing.

Sign in to add a comment