Pinpoint jobs failing with IsolateNotFoundError. |
||||||
Issue description
My pinpoint tryjobs have constantly been failing with this error:
Traceback (most recent call last):
File "/base/data/home/apps/s~chromeperf/pinpoint:clean-dtu-3f7d74f7.413040965508556777/dashboard/pinpoint/models/job.py", line 350, in Run
work_left = self.state.ScheduleWork()
File "/base/data/home/apps/s~chromeperf/pinpoint:clean-dtu-3f7d74f7.413040965508556777/dashboard/pinpoint/models/job_state.py", line 135, in ScheduleWork
attempt.ScheduleWork()
File "/base/data/home/apps/s~chromeperf/pinpoint:clean-dtu-3f7d74f7.413040965508556777/dashboard/pinpoint/models/attempt.py", line 77, in ScheduleWork
self._Poll()
File "/base/data/home/apps/s~chromeperf/pinpoint:clean-dtu-3f7d74f7.413040965508556777/dashboard/pinpoint/models/attempt.py", line 81, in _Poll
self._last_execution.Poll()
File "/base/data/home/apps/s~chromeperf/pinpoint:clean-dtu-3f7d74f7.413040965508556777/dashboard/pinpoint/models/quest/execution.py", line 95, in Poll
self._Poll()
File "/base/data/home/apps/s~chromeperf/pinpoint:clean-dtu-3f7d74f7.413040965508556777/dashboard/pinpoint/models/quest/find_isolate.py", line 103, in _Poll
self._CheckBuildStatus()
File "/base/data/home/apps/s~chromeperf/pinpoint:clean-dtu-3f7d74f7.413040965508556777/dashboard/pinpoint/models/quest/find_isolate.py", line 164, in _CheckBuildStatus
'Buildbucket says the build completed successfully, '
IsolateNotFoundError: Buildbucket says the build completed successfully, but Pinpoint can't find the isolate hash.
Interestingly this only happens for the build with the patch applies but not the tot build. Here are some pinpoint runs which failed.
https://pinpoint-dot-chromeperf.appspot.com/job/12e13c06e40000
https://pinpoint-dot-chromeperf.appspot.com/job/15ad1132e40000
https://pinpoint-dot-chromeperf.appspot.com/job/10ece69ce40000
https://pinpoint-dot-chromeperf.appspot.com/job/1599a45ce40000
,
Oct 22
,
Oct 22
,
Oct 23
I think this is P1. Perf tryjobs do not work at the moment.
,
Oct 23
,
Oct 23
,
Oct 23
The following revision refers to this bug: https://chromium.googlesource.com/chromium/tools/build/+/5d59514a6105fa8aedaaa4f54e12f8cb0bd701ca commit 5d59514a6105fa8aedaaa4f54e12f8cb0bd701ca Author: Dave Tu <dtu@chromium.org> Date: Tue Oct 23 20:46:15 2018 [perf] Include "https://" in Gerrit server URL for Pinpoint upload. TBR=martiniss Bug: 897847 Change-Id: I5ff2aaeb0d2f54aa443db9c7c4ae4599a82bb241 Reviewed-on: https://chromium-review.googlesource.com/c/1296974 Reviewed-by: Dave Tu <dtu@chromium.org> Reviewed-by: Stephen Martinis <martiniss@chromium.org> Commit-Queue: Dave Tu <dtu@chromium.org> [modify] https://crrev.com/5d59514a6105fa8aedaaa4f54e12f8cb0bd701ca/scripts/slave/recipe_modules/perf_dashboard/api.py [modify] https://crrev.com/5d59514a6105fa8aedaaa4f54e12f8cb0bd701ca/scripts/slave/recipe_modules/chromium_tests/tests/api/compile_specific_targets.expected/perf_isolate_lookup_tryserver.json
,
Nov 16
Thanks for the fix Dave! I was seeing this behaviour too[1] but the job I ran last night[2] worked. Are we still seeing these errors somewhere or should we mark this bug fixed? [1] https://pinpoint-dot-chromeperf.appspot.com/job/139a7d5ae40000 [2] https://pinpoint-dot-chromeperf.appspot.com/job/11d9760fe40000
,
Dec 7
Fixed!
,
Dec 7
(If you still see this error it's probably issue 868926) |
||||||
►
Sign in to add a comment |
||||||
Comment 1 by sullivan@google.com
, Oct 22Owner: dtu@chromium.org