Issue metadata
Sign in to add a comment
|
3.4%-12% regression in thread_times.simple_mobile_sites at 433406:433453 |
||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Nov 21 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8995365536389645312
,
Nov 21 2016
===== BISECT JOB RESULTS ===== Status: failed === Bisection aborted === The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence. Please contact the the team (see below) if you believe this is in error. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@433429 2.9779 6.10308 25 good chromium@433443 3.31257 6.8215 25 bad Bisect job ran on: android_nexus5_perf_bisect Bug ID: 667342 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests thread_times.simple_mobile_sites Test Metric: thread_IO_cpu_time_per_frame/thread_IO_cpu_time_per_frame Relative Change: None Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/4359 Job details: https://chromeperf.appspot.com/buildbucket_job_status/8995365536389645312 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5228152782061568 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Nov 22 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8995272318163828944
,
Nov 22 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8995272285628746528
,
Nov 23 2016
===== BISECT JOB RESULTS ===== Status: failed === Bisection aborted === The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence. Please contact the the team (see below) if you believe this is in error. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@433429 12.193 18.741 25 good chromium@433452 12.8129 20.4601 25 bad Bisect job ran on: android_nexus5_perf_bisect Bug ID: 667342 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests thread_times.simple_mobile_sites Test Metric: thread_total_fast_path_cpu_time_per_frame/thread_total_fast_path_cpu_time_per_frame Relative Change: None Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/4371 Job details: https://chromeperf.appspot.com/buildbucket_job_status/8995272318163828944 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5815612335456256 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Nov 23 2016
===== BISECT JOB RESULTS ===== Status: failed === Bisection aborted === The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence. Please contact the the team (see below) if you believe this is in error. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@433429 2.93669 4.15347 25 good chromium@433452 3.10022 4.67593 25 bad Bisect job ran on: android_nexus5_perf_bisect Bug ID: 667342 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests thread_times.simple_mobile_sites Test Metric: thread_GPU_cpu_time_per_frame/thread_GPU_cpu_time_per_frame Relative Change: None Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/4372 Job details: https://chromeperf.appspot.com/buildbucket_job_status/8995272285628746528 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5883760313106432 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Apr 11 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8982651620901420240
,
Apr 11 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_nexus5_perf_bisect Benchmark : thread_times.simple_mobile_sites Metric : thread_IO_cpu_time_per_frame/thread_IO_cpu_time_per_frame Revision Result N chromium@433429 2.9779 +- 6.10308 25 good chromium@433443 3.31257 +- 6.8215 25 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests thread_times.simple_mobile_sites Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8982651620901420240 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5228152782061568 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Jul 7 2017
Twelve of the 13 plots recovered in the last 6 months except for: ChromiumPerf/android-nexus6/thread_times.simple_mobile_sites / thread_total_fast_path_cpu_time_per_frame But this one have seen too many ups/downs in these months, so the old regression seems meaningless. |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by mustaq@chromium.org
, Nov 21 2016