Downloading Catapult dependencies from cloud storage fails on Mac builders |
||||||||
Issue descriptionThe Mac builders are failing due to this error thrown during the "gclient runhooks" phase of https://ci.chromium.org/buildbot/chromium/Mac/40343: https://logs.chromium.org/v/?s=chromium%2Fbb%2Fchromium%2FMac%2F40343%2F%2B%2Frecipes%2Fsteps%2Fgclient_runhooks%2F0%2Fstdout <module> at /b/c/b/mac/src/tools/perf/fetch_benchmark_deps.py:126 main(sys.argv[1:]) main at /b/c/b/mac/src/tools/perf/fetch_benchmark_deps.py:123 FetchDepsForBenchmark(b) FetchDepsForBenchmark at /b/c/b/mac/src/tools/perf/fetch_benchmark_deps.py:76 _FetchDependenciesIfNeeded(story_set) _FetchDependenciesIfNeeded at /b/c/b/mac/src/tools/perf/fetch_benchmark_deps.py:38 story_set.wpr_archive_info.DownloadArchivesIfNeeded() DownloadArchivesIfNeeded at /b/c/b/mac/src/third_party/catapult/telemetry/telemetry/wpr/archive_info.py:107 download_if_needed(archive_path) download_if_needed at /b/c/b/mac/src/third_party/catapult/telemetry/telemetry/wpr/archive_info.py:86 cloud_storage.GetIfChanged(path, self._bucket) GetIfChanged at /b/c/b/mac/src/third_party/catapult/common/py_utils/py_utils/cloud_storage.py:421 expected_hash = ReadHash(hash_path) ReadHash at /b/c/b/mac/src/third_party/catapult/common/py_utils/py_utils/cloud_storage.py:497 return f.read(1024).rstrip() IOError: [Errno 5] Input/output error
,
Apr 11 2018
@sergeyberezin, are you familiar with the Mac builders?
,
Apr 11 2018
Not really... Bet UURC they were recently flipped to LUCI (?) I'd look into fetch_benchmark_deps.py and see what it's trying to do. In particular, which GS bucket it's trying to read, and if the bot has permissions to read from it. gsutil acl get gs://<bucket> should give you ACL list.
,
Apr 11 2018
...*But IIRC*...
,
Apr 11 2018
Bumping to p0; this is blocking the Chromium build tree.
,
Apr 11 2018
I'll look into temporarily disabling the code that relies on this.
,
Apr 11 2018
,
Apr 11 2018
,
Apr 11 2018
Possibly related to https://bugs.chromium.org/p/chromium/issues/detail?id=831730#c10 I SSHed onto the bot and restarted the buildbot slave process.
,
Apr 11 2018
Next build appears to have cleared gclient runhooks.
,
Apr 12 2018
looks like this was a transient network issue, though the bot is still having problems with sizes.
,
Jan 16
(6 days ago)
,
Jan 16
(6 days ago)
|
||||||||
►
Sign in to add a comment |
||||||||
Comment 1 by hzl@chromium.org
, Apr 11 2018