New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 831805 link

Starred by 2 users

Issue metadata

Status: Fixed
Owner:
Closed: Apr 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Mac
Pri: 0
Type: Bug



Sign in to add a comment

Downloading Catapult dependencies from cloud storage fails on Mac builders

Project Member Reported by kmarshall@chromium.org, Apr 11 2018

Issue description

The Mac builders are failing due to this error thrown during the "gclient runhooks" phase of https://ci.chromium.org/buildbot/chromium/Mac/40343:

https://logs.chromium.org/v/?s=chromium%2Fbb%2Fchromium%2FMac%2F40343%2F%2B%2Frecipes%2Fsteps%2Fgclient_runhooks%2F0%2Fstdout
  <module> at /b/c/b/mac/src/tools/perf/fetch_benchmark_deps.py:126
    main(sys.argv[1:])
  main at /b/c/b/mac/src/tools/perf/fetch_benchmark_deps.py:123
    FetchDepsForBenchmark(b)
  FetchDepsForBenchmark at /b/c/b/mac/src/tools/perf/fetch_benchmark_deps.py:76
    _FetchDependenciesIfNeeded(story_set)
  _FetchDependenciesIfNeeded at /b/c/b/mac/src/tools/perf/fetch_benchmark_deps.py:38
    story_set.wpr_archive_info.DownloadArchivesIfNeeded()
  DownloadArchivesIfNeeded at /b/c/b/mac/src/third_party/catapult/telemetry/telemetry/wpr/archive_info.py:107
    download_if_needed(archive_path)
  download_if_needed at /b/c/b/mac/src/third_party/catapult/telemetry/telemetry/wpr/archive_info.py:86
    cloud_storage.GetIfChanged(path, self._bucket)
  GetIfChanged at /b/c/b/mac/src/third_party/catapult/common/py_utils/py_utils/cloud_storage.py:421
    expected_hash = ReadHash(hash_path)
  ReadHash at /b/c/b/mac/src/third_party/catapult/common/py_utils/py_utils/cloud_storage.py:497
    return f.read(1024).rstrip()
IOError: [Errno 5] Input/output error


 

Comment 1 by hzl@chromium.org, Apr 11 2018

Cc: sergeybe...@chromium.org

Comment 2 by hzl@chromium.org, Apr 11 2018

@sergeyberezin, are you familiar with the Mac builders?
Not really... Bet UURC they were recently flipped to LUCI (?)

I'd look into fetch_benchmark_deps.py and see what it's trying to do. In particular, which GS bucket it's trying to read, and if the bot has permissions to read from it.

gsutil acl get gs://<bucket>

should give you ACL list.
...*But IIRC*...
Labels: -Pri-1 Pri-0
Bumping to p0; this is blocking the Chromium build tree.
I'll look into temporarily disabling the code that relies on this.
Components: Speed>Telemetry Tests>Telemetry Infra>Client>Chrome
Status: Assigned (was: Untriaged)
Cc: jbudorick@chromium.org
Owner: jbudorick@chromium.org
Status: Started (was: Assigned)
Possibly related to https://bugs.chromium.org/p/chromium/issues/detail?id=831730#c10

I SSHed onto the bot and restarted the buildbot slave process.
Next build appears to have cleared gclient runhooks.
Status: Fixed (was: Started)
looks like this was a transient network issue, though the bot is still having problems with sizes.

Comment 12 by benhenry@google.com, Jan 16 (6 days ago)

Components: Test>Telemetry

Comment 13 by benhenry@google.com, Jan 16 (6 days ago)

Components: -Speed>Telemetry

Sign in to add a comment