New issue
Advanced search Search tips

Issue 719717 link

Starred by 1 user
Status: Fixed
Owner: ----
Closed: May 2017
Cc:
rmis...@google.com
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: ----
Type: ----



Sign in to add a comment

Frequent HTTP 500 errors on cl upload

Project Member Reported by roc...@chromium.org, May 8 2017 
I've hit this multiple times when uploading https://chromium-review.googlesource.com/498972, on both the initial upload and every patchset upload thereafter.

Seems like the patchset contents are being uploaded completely and correctly. Output follows:


remote: Processing changes: updated: 1, done            
remote: 
remote: Updated Changes:        
remote:   https://chromium-review.googlesource.com/498972 Resurface EDK IPC API        
remote: 
To https://chromium.googlesource.com/chromium/src.git
 * [new branch]                e35beee64d6fe761126fbef868b3fc21c1edf82b -> refs/for/refs/heads/master%m=,notify=NONE
[W2017-05-08 14:52:20,287 6374 139675340621632 gerrit_util.py] A transient error occurred while querying chromium-review.googlesource.com:
POST https://chromium-review.googlesource.com/a/changes/498972/reviewers HTTP/1.1
HTTP/1.1 500 Internal Server Error
[W2017-05-08 14:52:20,287 6374 139675340621632 gerrit_util.py] ... will retry 4 more times.
[W2017-05-08 14:52:21,533 6374 139675340621632 gerrit_util.py] A transient error occurred while querying chromium-review.googlesource.com:
POST https://chromium-review.googlesource.com/a/changes/498972/reviewers HTTP/1.1
HTTP/1.1 500 Internal Server Error
[W2017-05-08 14:52:21,533 6374 139675340621632 gerrit_util.py] ... will retry 3 more times.
[W2017-05-08 14:52:23,361 6374 139675340621632 gerrit_util.py] A transient error occurred while querying chromium-review.googlesource.com:
POST https://chromium-review.googlesource.com/a/changes/498972/reviewers HTTP/1.1
HTTP/1.1 500 Internal Server Error
[W2017-05-08 14:52:23,361 6374 139675340621632 gerrit_util.py] ... will retry 2 more times.
[W2017-05-08 14:52:25,946 6374 139675340621632 gerrit_util.py] A transient error occurred while querying chromium-review.googlesource.com:
POST https://chromium-review.googlesource.com/a/changes/498972/reviewers HTTP/1.1
HTTP/1.1 500 Internal Server Error
[W2017-05-08 14:52:25,946 6374 139675340621632 gerrit_util.py] ... will retry 1 more times.
[W2017-05-08 14:52:30,501 6374 139675340621632 gerrit_util.py] A transient error occurred while querying chromium-review.googlesource.com:
POST https://chromium-review.googlesource.com/a/changes/498972/reviewers HTTP/1.1
HTTP/1.1 500 Internal Server Error

Comment 1 by aga...@chromium.org, May 11 2017

Status: Fixed (was: Unconfirmed)
There was a partial gerrit outage a couple days ago. It seems likely you were running into that.

The call that is failing is a call that git-cl makes to update the reviewers/ccs after updating the patchset. We've recently refactored this code, and it should be a bit more stable now. But we already have retries with some backoff built in, so there's not a whole lot more we can do from the git-cl side.

Comment 2 by roc...@chromium.org, May 11 2017 

It may be helpful to have the output here clarify that it's a Gerrit
service issue (though maybe that's obvious.)

I can vaguely recall maybe one or two Rietveld outages in the last 4 years.
Gerrit in general seems to be a far less reliable service in that regard.
Have I just been unlucky, or does Gerrit have resource/stability issues
that need to be escalated before Chromium can commit to it 100%?
►

Sign in to add a comment