New issue
Advanced search Search tips
Starred by 1 user
Status: Duplicate
Owner:
Closed: Dec 5
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 0
Type: Bug



Sign in to add a comment
Chrome PFQ failed at TestSimpleChromeWorkflow step
Project Member Reported by x...@chromium.org, Dec 5 Back to list
The failure starts showing on PFQ on 12/02. See an example failed build: https://uberchromegw.corp.google.com/i/chromeos/builders/caroline-chrome-pfq/builds/910

Selected error messages:
Restoring previous backed up file (/b/build/site_config/.boto.bak)
Failure: EOF when reading a line.
cmd=['/tmp/cbuildbot-tmp_ilU_C/chrome-sdk-cache53nna8/cache/common/gsutil_4.27.tar.gz/gsutil/gsutil', '-o', 'Boto:num_retries=10', 'config'], extra env={'BOTO_CONFIG': '/b/build/site_config/.boto'})
04:23:54: ERROR: cros chrome-sdk failed before completing.
cros: Unhandled exception:
Traceback (most recent call last):
  File "/b/c/cbuild/repository/chromite/bin/cros", line 169, in <module>
    DoMain()
  File "/b/c/cbuild/repository/chromite/bin/cros", line 165, in DoMain
    commandline.ScriptWrapperMain(FindTarget)
  File "/b/c/cbuild/repository/chromite/lib/commandline.py", line 911, in ScriptWrapperMain
    ret = target(argv[1:])
  File "/b/c/cbuild/repository/chromite/scripts/cros.py", line 66, in main
    code = _RunSubCommand(subcommand)
  File "/b/c/cbuild/repository/chromite/scripts/cros.py", line 51, in _RunSubCommand
    return subcommand.Run()
  File "/b/c/cbuild/repository/chromite/cli/cros/cros_chrome_sdk.py", line 1041, in Run
    use_external_config=self.options.use_external_config)
  File "/b/c/cbuild/repository/chromite/cli/cros/cros_chrome_sdk.py", line 133, in __init__
    self.gs_ctx = gs.GSContext(cache_dir=cache_dir, init_boto=internal)
  File "/b/c/cbuild/repository/chromite/lib/gs.py", line 582, in __init__
    self._InitBoto()
  File "/b/c/cbuild/repository/chromite/lib/gs.py", line 650, in _InitBoto
    self._ConfigureBotoConfig()
  File "/b/c/cbuild/repository/chromite/lib/gs.py", line 641, in _ConfigureBotoConfig
    print_cmd=False)
  File "/b/c/cbuild/repository/chromite/lib/gs.py", line 878, in DoCommand
    raise GSCommandError(e.msg, e.result, e.exception)
 
rspangler@ mentioned that it seems a gsutil auth error, not one in Chrome. Anyone know who might have the right knowledge for this?
Cc: dpranke@chromium.org akes...@chromium.org
Owner: pho...@chromium.org
Status: Assigned
Here is the actual error:

00:36:47: DEBUG: RunCommand: /tmp/cbuildbot-tmpEKMmvf/chrome-sdk-cache_CrLPt/cache/common/gsutil_4.27.tar.gz/gsutil/gsutil -o 'Boto:num_retries=10' ls
Configuring gsutil. **Please use your @google.com account.**

As mentioned in comment #1, this is an infra / authentication issue so it should be assigned to the cros infra deputy (phobbs@)

Cc: jrbarnette@chromium.org dgarr...@chromium.org
Components: Infra>Client>ChromeOS
Labels: OS-Chrome
Worth noting:
* It's not failing on external builders: amd64-generic and arm-generic
* There were a number of chromite changes when the failure sstarted, including a number with 'validation_pool' in the comment (but I have no idea whether that is at all relevent)


Labels: -Pri-1 Pri-0
Marking this a P0 since we haven't had a PFQ uprev since 11/29

Mergedinto: 791643
Status: Duplicate
Sign in to add a comment