Issue metadata
Sign in to add a comment
|
13.4% regression in thread_times.tough_scrolling_cases at 433321:433440 |
||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Nov 21 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8995358004110216848
,
Nov 21 2016
===== BISECT JOB RESULTS ===== Status: failed === Bisection aborted === The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence. Please contact the the team (see below) if you believe this is in error. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@433320 42.5236 306.651 200 good chromium@433440 46.727 377.224 200 bad Bisect job ran on: android_nexus5_perf_bisect Bug ID: 667417 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests thread_times.tough_scrolling_cases Test Metric: thread_total_all_cpu_time_per_frame/thread_total_all_cpu_time_per_frame Relative Change: None Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/4361 Job details: https://chromeperf.appspot.com/buildbucket_job_status/8995358004110216848 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=6065859846471680 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Nov 22 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8995272543890956384
,
Nov 22 2016
===== BISECT JOB RESULTS ===== Status: failed === Bisection aborted === The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence. Please contact the the team (see below) if you believe this is in error. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@433320 42.8799 313.22 200 good chromium@433440 47.0234 387.959 200 bad Bisect job ran on: android_nexus5_perf_bisect Bug ID: 667417 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests thread_times.tough_scrolling_cases Test Metric: thread_total_all_cpu_time_per_frame/thread_total_all_cpu_time_per_frame Relative Change: None Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/4370 Job details: https://chromeperf.appspot.com/buildbucket_job_status/8995272543890956384 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=6462242210447360 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Nov 29 2016
,
Jan 12 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8990640885077534320
,
Jan 13 2017
=== BISECT JOB RESULTS === Perf regression found but unable to narrow commit range Bisect Details Configuration: android_nexus5_perf_bisect Benchmark : thread_times.tough_scrolling_cases Metric : thread_total_all_cpu_time_per_frame/thread_total_all_cpu_time_per_frame Suspected Commit Range 30 commits in range https://chromium.googlesource.com/chromium/src/+log/4312c9f8688669f7adb6a6102cf73e8e58777c8d..662a14a241ac885aa219849f2267acb8af0df3e5 Revision Result N chromium@433320 41.3725 +- 0.846351 6 good chromium@433380 41.6951 +- 2.26543 6 good chromium@433410 41.149 +- 1.03083 6 good chromium@433440 46.846 +- 1.392 6 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests thread_times.tough_scrolling_cases Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8990640885077534320 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5837287503429632 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jul 7 2017
All plots recovered except for: ChromiumPerf/chromium-rel-mac10/thread_times.tough_scrolling_cases / thread_total_all_cpu_time_per_frame which has very little regression since the original level, and it's noisy. |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by mustaq@chromium.org
, Nov 21 2016