New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.
Starred by 1 user

Issue metadata

Status: Duplicate
Last visit > 30 days ago
Closed: Dec 2017
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 0
Type: Bug

Sign in to add a comment

Issue 792115: Chrome PFQ failed at TestSimpleChromeWorkflow step

Reported by, Dec 5 2017 Project Member

Issue description

The failure starts showing on PFQ on 12/02. See an example failed build:

Selected error messages:
Restoring previous backed up file (/b/build/site_config/.boto.bak)
Failure: EOF when reading a line.
cmd=['/tmp/cbuildbot-tmp_ilU_C/chrome-sdk-cache53nna8/cache/common/gsutil_4.27.tar.gz/gsutil/gsutil', '-o', 'Boto:num_retries=10', 'config'], extra env={'BOTO_CONFIG': '/b/build/site_config/.boto'})
04:23:54: ERROR: cros chrome-sdk failed before completing.
cros: Unhandled exception:
Traceback (most recent call last):
  File "/b/c/cbuild/repository/chromite/bin/cros", line 169, in <module>
  File "/b/c/cbuild/repository/chromite/bin/cros", line 165, in DoMain
  File "/b/c/cbuild/repository/chromite/lib/", line 911, in ScriptWrapperMain
    ret = target(argv[1:])
  File "/b/c/cbuild/repository/chromite/scripts/", line 66, in main
    code = _RunSubCommand(subcommand)
  File "/b/c/cbuild/repository/chromite/scripts/", line 51, in _RunSubCommand
    return subcommand.Run()
  File "/b/c/cbuild/repository/chromite/cli/cros/", line 1041, in Run
  File "/b/c/cbuild/repository/chromite/cli/cros/", line 133, in __init__
    self.gs_ctx = gs.GSContext(cache_dir=cache_dir, init_boto=internal)
  File "/b/c/cbuild/repository/chromite/lib/", line 582, in __init__
  File "/b/c/cbuild/repository/chromite/lib/", line 650, in _InitBoto
  File "/b/c/cbuild/repository/chromite/lib/", line 641, in _ConfigureBotoConfig
  File "/b/c/cbuild/repository/chromite/lib/", line 878, in DoCommand
    raise GSCommandError(e.msg, e.result, e.exception)

Comment 1 by, Dec 5 2017

rspangler@ mentioned that it seems a gsutil auth error, not one in Chrome. Anyone know who might have the right knowledge for this?

Comment 2 by, Dec 5 2017

Status: Assigned (was: Untriaged)
Here is the actual error:

00:36:47: DEBUG: RunCommand: /tmp/cbuildbot-tmpEKMmvf/chrome-sdk-cache_CrLPt/cache/common/gsutil_4.27.tar.gz/gsutil/gsutil -o 'Boto:num_retries=10' ls
Configuring gsutil. **Please use your account.**

As mentioned in comment #1, this is an infra / authentication issue so it should be assigned to the cros infra deputy (phobbs@)

Comment 3 by, Dec 5 2017

Components: Infra>Client>ChromeOS
Labels: OS-Chrome
Worth noting:
* It's not failing on external builders: amd64-generic and arm-generic
* There were a number of chromite changes when the failure sstarted, including a number with 'validation_pool' in the comment (but I have no idea whether that is at all relevent)

Comment 4 by, Dec 5 2017

Labels: -Pri-1 Pri-0
Marking this a P0 since we haven't had a PFQ uprev since 11/29

Comment 5 by, Dec 5 2017

Mergedinto: 791643
Status: Duplicate (was: Assigned)

Sign in to add a comment