Bisect operations on perf TryBots are failing |
|||||
Issue descriptionI submitted several perf bisect jobs today, and they have all failed due to infrastructure issue. The failures all occurred in step: "read test spec (tryserver.chromium.perf.json)", with following error message: IOError: [Errno 2] No such file or directory: '/b/c/b/mac_10_12_perf_bisect/src/testing/buildbot/tryserver.chromium.perf.json' Here are the failed jobs: https://chromeperf.appspot.com/buildbucket_job_status/8974080484463230992 https://chromeperf.appspot.com/buildbucket_job_status/8974064157513177104 https://chromeperf.appspot.com/buildbucket_job_status/8974064021785823968
,
Jul 14 2017
Started another bisect job: https://chromeperf.appspot.com/buildbucket_job_status/8974060211978385264
,
Jul 14 2017
The bisect job went past the original failure point, but now it failed at "Post bisect results" step, with "500 Internal Server Error". Could you please take a look at https://build.chromium.org/p/tryserver.chromium.perf/builders/mac_10_12_perf_bisect/builds/348
,
Jul 16 2017
Simon, can you take a look? searching go/chromeperf-logs for 'path:/post_biset_results status:500' gives errors like this: 'ascii' codec can't encode character u'\xed' in position 114: ordinal not in range(128) (/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py:1553) Traceback (most recent call last): File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1536, in __call__ rv = self.handle_exception(request, response, e) File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1530, in __call__ rv = self.router.dispatch(request, response) File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1278, in default_dispatcher return route.handler_adapter(request, response) File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1102, in __call__ return handler.dispatch() File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 572, in dispatch return self.handle_exception(e, self.app.debug) File "/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 570, in dispatch return method(*args, **kwargs) File "/base/data/home/apps/s~chromeperf/clean-sullivan-7a8b1fc5.402644400137199241/dashboard/post_bisect_results.py", line 73, in post update_bug_with_results.UpdateQuickLog(job, in_progress=True) File "/base/data/home/apps/s~chromeperf/clean-sullivan-7a8b1fc5.402644400137199241/dashboard/update_bug_with_results.py", line 439, in UpdateQuickLog logger.Log(report, record_id=job.log_record_id) File "/base/data/home/apps/s~chromeperf/clean-sullivan-7a8b1fc5.402644400137199241/dashboard/quick_logger.py", line 235, in Log message = str(message) UnicodeEncodeError: 'ascii' codec can't encode character u'\xed' in position 114: ordinal not in range(128)
,
Jul 17 2017
,
Jul 17 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/c11ba88cadf0f4d5b08616dc302b91d8fd16525a commit c11ba88cadf0f4d5b08616dc302b91d8fd16525a Author: catapult-deps-roller@chromium.org <catapult-deps-roller@chromium.org> Date: Mon Jul 17 22:35:15 2017 Roll src/third_party/catapult/ 64ca2b5ad..a9f03426f (4 commits) https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/64ca2b5ad4d4..a9f03426f2e4 $ git log 64ca2b5ad..a9f03426f --date=short --no-merges --format='%ad %ae %s' 2017-07-17 simonhatch Dashboard - Change /get_histogram to always use same error message. 2017-07-17 trojal Add lowmemorykiller events to Memory Events track. 2017-07-17 simonhatch Dashboard - Convert bisect report from unicode. 2017-07-17 perezju [devil] Include stderr on RunShellCommand with large_output Created with: roll-dep src/third_party/catapult BUG= 743171 Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, see: http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=sullivan@chromium.org Change-Id: Ida3150a9fd640b0f0dbaa0f30a0c03e2e65802ae Reviewed-on: https://chromium-review.googlesource.com/575352 Reviewed-by: <catapult-deps-roller@chromium.org> Commit-Queue: <catapult-deps-roller@chromium.org> Cr-Commit-Position: refs/heads/master@{#487279} [modify] https://crrev.com/c11ba88cadf0f4d5b08616dc302b91d8fd16525a/DEPS
,
Aug 1
,
Oct 4
We use Pinpoint now. |
|||||
►
Sign in to add a comment |
|||||
Comment 1 by sullivan@chromium.org
, Jul 14 2017Components: -Speed>Telemetry Speed>Bisection