New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 819874 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Last visit > 30 days ago
Closed: Mar 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Linux , Android , Windows , Mac
Pri: 1
Type: Bug

Blocked on:
issue 819751

Blocking:
issue 815092



Sign in to add a comment

Can't fetch Telemetry dependencies on public LUCI bots

Project Member Reported by kbr@chromium.org, Mar 8 2018

Issue description

See this newly deployed LUCI bot:
https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/GPU%20FYI%20Linux%20Builder/34

It fails gclient runhooks with:

----------
Fetch dependencies for benchmark blink_perf.layout
Fetch dependencies for benchmark memory.desktop
tools/perf/page_sets/trivial_sites/bunny.gif
tools/perf/page_sets/trivial_sites/road_trip_640_480.mp4
Fetch dependencies for benchmark smoothness.gpu_rasterization.tough_scrolling_cases
Fetch dependencies for benchmark battor.steady_state
ERROR:root:You either aren't authenticated or don't have permission to use the archives for this page set.
You may need to run gsutil config.
You can find instructions for gsutil config at: http://www.chromium.org/developers/telemetry/upload_to_cloud_storage
Traceback (most recent call last):
  <module> at /b/swarming/w/ir/cache/builder/linux/src/tools/perf/fetch_benchmark_deps.py:115
    main(sys.argv[1:], sys.stdout)
  main at /b/swarming/w/ir/cache/builder/linux/src/tools/perf/fetch_benchmark_deps.py:112
    FetchDepsForBenchmark(b, output)
  FetchDepsForBenchmark at /b/swarming/w/ir/cache/builder/linux/src/tools/perf/fetch_benchmark_deps.py:75
    _FetchDependenciesIfNeeded(story_set)
  _FetchDependenciesIfNeeded at /b/swarming/w/ir/cache/builder/linux/src/tools/perf/fetch_benchmark_deps.py:37
    story_set.wpr_archive_info.DownloadArchivesIfNeeded()
  DownloadArchivesIfNeeded at /b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/telemetry/telemetry/wpr/archive_info.py:107
    download_if_needed(archive_path)
  download_if_needed at /b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/telemetry/telemetry/wpr/archive_info.py:86
    cloud_storage.GetIfChanged(path, self._bucket)
  GetIfChanged at /b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/common/py_utils/py_utils/cloud_storage.py:451
    _GetLocked(bucket, expected_hash, file_path)
  _GetLocked at /b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/common/py_utils/py_utils/cloud_storage.py:349
    _RunCommand(['cp', url, partial_download_path.name])
  _RunCommand at /b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/common/py_utils/py_utils/cloud_storage.py:154
    raise GetErrorObjectForCloudStorageStderr(stderr)
PermissionError: Attempted to access a file from Cloud Storage but you don't have permission. To configure your credentials:
  1. Run "/b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/third_party/gsutil/gsutil config" and follow its instructions.
  2. If you have a @google.com account, use that account.
  3. For the project-id, just enter 0.
Locals:
  args       : ['/b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/third_party/gsutil/gsutil', 'cp', 'gs://chrome-partner-telemetry/d0476796300625c01a16e4893f9abb848bc32a6a', u'/b/swarming/w/ir/cache/builder/linux/src/tools/perf/page_sets/data/tmpGQ1URQ']
  gsutil     : <subprocess.Popen object at 0x7fd833bbcc50>
  gsutil_env : None
  stderr     : 'AccessDeniedException: 403 chromium-ci-gpu-builder@chops-service-accounts.iam.gserviceaccount.com does not have storage.objects.list access to chrome-partner-telemetry.\n'
  stdout     : ''
Error: Command 'vpython src/tools/perf/fetch_benchmark_deps.py -f' returned non-zero exit status 1 in /b/swarming/w/ir/cache/builder/linux
step returned non-zero exit code: 2
----------

We don't actually need to fetch Telemetry's binary dependencies any more now that vpython is the default (even for buildbot, and especially for LUCI) and that the cv2 and numpy wheels are installed. Taking that out of the bots' configuration globally.

 

Comment 1 by kbr@chromium.org, Mar 8 2018

Cc: tandrii@chromium.org iannucci@chromium.org hinoka@chromium.org
Yes, they probably also need some permissions granted to corresponding existing accounts. See go/chops-task-accounts-permissions

Comment 4 by kbr@chromium.org, Mar 8 2018

Blockedon: 819751
Blocking: 815092
Components: Infra>Client>Chrome
Owner: iannucci@chromium.org
Status: Started (was: Assigned)
Talking with Robbie, yes, this is in fact a problem with the newly created service account. Watching him fix it as we speak.

Comment 5 by kbr@chromium.org, Mar 8 2018

Status: Fixed (was: Started)
These permissions were "Storage Legacy Bucket Reader" on gs://chrome-partner-telemetry for:

chromium-ci-gpu-builder@chops-service-accounts.iam.gserviceaccount.com
chromium-try-gpu-builder@chops-service-accounts.iam.gserviceaccount.com

Sign in to add a comment