New issue
Advanced search Search tips

Issue 620284 link

Starred by 1 user

Issue metadata

Status: Fixed
Merged: issue 620249
Owner: ----
Closed: Jun 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 0
Type: Bug



Sign in to add a comment

Perf waterfall 502'ing

Project Member Reported by picksi@chromium.org, Jun 15 2016

Issue description

Perf waterfall is down.

https://uberchromegw.corp.google.com/i/chromium.perf dies with a HTTP status code 502.

Other builder's pages are dead, like this:

Proxy Error

The proxy server received an invalid response from an upstream server.
The proxy server could not handle the request GET /p/chromium.perf/waterfall.

Reason: Error reading from remote server


 

Comment 1 by picksi@chromium.org, Jun 15 2016

Labels: Performance-BotHealth
Mergedinto: 620249
Status: Duplicate (was: Untriaged)
This is probably due to me issuing heavy requests to it. I've just restarted the master, so it will take some time to get back.
Status: Available (was: Duplicate)
Hm. On a second thought.... this may be a separate issue. Overloaded master should result in 5xx errors, not 403.
Status: Untriaged (was: Available)
Status: Fixed (was: Untriaged)
Hm. It's back now. Seems like we get 403 when master is starting. Wierd.

Comment 6 by picksi@chromium.org, Jun 15 2016

Status: Unconfirmed (was: Fixed)
Many bots are purple following the restart. Will they come back over time, or do we need manual restarts on the devices too?

Re-opening this for visibility. Please close if this is unrelated to the purpleness.
Status: Fixed (was: Unconfirmed)
Bots are purple because I've restarted the master. Jobs were killed. New jobs were scheduled for most of them and will change purple to green/red after they are finished (may take a couple of hours).

Comment 8 by picksi@chromium.org, Jun 15 2016

We're seeing possible fallout from this here:

https://bugs.chromium.org/p/chromium/issues/detail?id=620333

Much redness. Three consecutive builds on 6 (?) bots have gone red.

Sign in to add a comment