Can't fetch Telemetry dependencies on public LUCI bots |
|||
Issue descriptionSee this newly deployed LUCI bot: https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/GPU%20FYI%20Linux%20Builder/34 It fails gclient runhooks with: ---------- Fetch dependencies for benchmark blink_perf.layout Fetch dependencies for benchmark memory.desktop tools/perf/page_sets/trivial_sites/bunny.gif tools/perf/page_sets/trivial_sites/road_trip_640_480.mp4 Fetch dependencies for benchmark smoothness.gpu_rasterization.tough_scrolling_cases Fetch dependencies for benchmark battor.steady_state ERROR:root:You either aren't authenticated or don't have permission to use the archives for this page set. You may need to run gsutil config. You can find instructions for gsutil config at: http://www.chromium.org/developers/telemetry/upload_to_cloud_storage Traceback (most recent call last): <module> at /b/swarming/w/ir/cache/builder/linux/src/tools/perf/fetch_benchmark_deps.py:115 main(sys.argv[1:], sys.stdout) main at /b/swarming/w/ir/cache/builder/linux/src/tools/perf/fetch_benchmark_deps.py:112 FetchDepsForBenchmark(b, output) FetchDepsForBenchmark at /b/swarming/w/ir/cache/builder/linux/src/tools/perf/fetch_benchmark_deps.py:75 _FetchDependenciesIfNeeded(story_set) _FetchDependenciesIfNeeded at /b/swarming/w/ir/cache/builder/linux/src/tools/perf/fetch_benchmark_deps.py:37 story_set.wpr_archive_info.DownloadArchivesIfNeeded() DownloadArchivesIfNeeded at /b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/telemetry/telemetry/wpr/archive_info.py:107 download_if_needed(archive_path) download_if_needed at /b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/telemetry/telemetry/wpr/archive_info.py:86 cloud_storage.GetIfChanged(path, self._bucket) GetIfChanged at /b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/common/py_utils/py_utils/cloud_storage.py:451 _GetLocked(bucket, expected_hash, file_path) _GetLocked at /b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/common/py_utils/py_utils/cloud_storage.py:349 _RunCommand(['cp', url, partial_download_path.name]) _RunCommand at /b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/common/py_utils/py_utils/cloud_storage.py:154 raise GetErrorObjectForCloudStorageStderr(stderr) PermissionError: Attempted to access a file from Cloud Storage but you don't have permission. To configure your credentials: 1. Run "/b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/third_party/gsutil/gsutil config" and follow its instructions. 2. If you have a @google.com account, use that account. 3. For the project-id, just enter 0. Locals: args : ['/b/swarming/w/ir/cache/builder/linux/src/third_party/catapult/third_party/gsutil/gsutil', 'cp', 'gs://chrome-partner-telemetry/d0476796300625c01a16e4893f9abb848bc32a6a', u'/b/swarming/w/ir/cache/builder/linux/src/tools/perf/page_sets/data/tmpGQ1URQ'] gsutil : <subprocess.Popen object at 0x7fd833bbcc50> gsutil_env : None stderr : 'AccessDeniedException: 403 chromium-ci-gpu-builder@chops-service-accounts.iam.gserviceaccount.com does not have storage.objects.list access to chrome-partner-telemetry.\n' stdout : '' Error: Command 'vpython src/tools/perf/fetch_benchmark_deps.py -f' returned non-zero exit status 1 in /b/swarming/w/ir/cache/builder/linux step returned non-zero exit code: 2 ---------- We don't actually need to fetch Telemetry's binary dependencies any more now that vpython is the default (even for buildbot, and especially for LUCI) and that the cv2 and numpy wheels are installed. Taking that out of the bots' configuration globally.
,
Mar 8 2018
Actually, this is working on the Linux bots that have already been migrated to LUCI. https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/GPU%20Linux%20Builder https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Linux%20Builder See: https://cs.chromium.org/chromium/build/scripts/slave/recipe_modules/chromium_tests/chromium_gpu.py?l=87 https://cs.chromium.org/chromium/build/scripts/slave/recipe_modules/chromium_tests/chromium_linux.py?l=98 Maybe a problem with the newly created service account?
,
Mar 8 2018
Yes, they probably also need some permissions granted to corresponding existing accounts. See go/chops-task-accounts-permissions
,
Mar 8 2018
These permissions were "Storage Legacy Bucket Reader" on gs://chrome-partner-telemetry for: chromium-ci-gpu-builder@chops-service-accounts.iam.gserviceaccount.com chromium-try-gpu-builder@chops-service-accounts.iam.gserviceaccount.com |
|||
►
Sign in to add a comment |
|||
Comment 1 by kbr@chromium.org
, Mar 8 2018