New issue
Advanced search Search tips

Issue 598329 link

Starred by 2 users

Issue metadata

Status: Archived
Owner: ----
Closed: Oct 10
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

upload_to_google_storage.py possible race condition in upload.

Project Member Reported by d...@chromium.org, Mar 28 2016

Issue description

https://uberchromegw.corp.google.com/i/chromium.infra/builders/infra-continuous-mac-10.7-64/builds/857

Main> Done calculating hash for /Volumes/data/b/build/slave/infra-continuous/build/infra/go/bin/swarming.
0> Uploading /Volumes/data/b/build/slave/infra-continuous/build/infra/go/bin/cipd...
0> Uploading /Volumes/data/b/build/slave/infra-continuous/build/infra/go/bin/isolate...
0> Uploading /Volumes/data/b/build/slave/infra-continuous/build/infra/go/bin/isolated...
0> Uploading /Volumes/data/b/build/slave/infra-continuous/build/infra/go/bin/kitchen...
0> Uploading /Volumes/data/b/build/slave/infra-continuous/build/infra/go/bin/logdog_annotee...
0> Uploading /Volumes/data/b/build/slave/infra-continuous/build/infra/go/bin/logdog_butler...
0> Uploading /Volumes/data/b/build/slave/infra-continuous/build/infra/go/bin/logdog_cat...
0> Uploading /Volumes/data/b/build/slave/infra-continuous/build/infra/go/bin/rpc...
0> Uploading /Volumes/data/b/build/slave/infra-continuous/build/infra/go/bin/swarming...
Hashing 9 files took 0.246923 seconds
Encountered error on setting metadata on gs://chromium-luci/ab003c1b64e27a839082e40bc750e63e5702c2b3
Uploading took 51.798317 seconds
Setting metadata on gs://chromium-luci/ab003c1b64e27a839082e40bc750e63e5702c2b3...
NotFoundException: 404 gs://chromium-luci/ab003c1b64e27a839082e40bc750e63e5702c2b3 does not exist.

This seems like a potential race condition / consistency lapse between upload and the set meta step. I've only seen this once, in the linked build.
 
Summary: upload_to_google_storage.py possible race condition in upload. (was: cipd possible race condition in upload.)
This has nothing to do with cipd. It's these lines: https://code.google.com/p/chromium/codesearch#chromium/build/scripts/slave/recipes/infra/infra_continuous.py&l=77

Comment 2 by d...@chromium.org, Mar 28 2016

D'oh sorry about that, I don't know why I got that wrong.

Comment 3 by stip@chromium.org, Mar 30 2016

Labels: -Infra Infra-Platform

Comment 4 by aga...@chromium.org, Apr 27 2016

Components: Infra>Platform
Labels: -Infra-Platform
Status: Available (was: Untriaged)
Project Member

Comment 6 by sheriffbot@chromium.org, Sep 4 2017

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available. If you change it back, also remove the "Hotlist-Recharge-Cold" label.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Labels: -Hotlist-Recharge-Cold
Status: Available (was: Untriaged)
I think that's still valid.
Project Member

Comment 8 by sheriffbot@chromium.org, Oct 4

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Status: Archived (was: Untriaged)
Nothing was done about this after 2+ years, and the link in #1 is now dead.

Sign in to add a comment