Issue metadata
Sign in to add a comment
|
9.4% regression in thread_times.simple_mobile_sites at 401522:401544 |
||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Jun 28 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@401521 2.22808 0.0243123 18 good chromium@401544 2.22728 0.0186595 18 bad Bisect job ran on: android_one_perf_bisect Bug ID: 623836 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests thread_times.simple_mobile_sites Test Metric: thread_GPU_cpu_time_per_frame/thread_GPU_cpu_time_per_frame Relative Change: 0.42% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1372 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9008647900117852768 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5872957948166144 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jun 28 2016
,
Jul 2 2016
Moving this nonessential bug to the next milestone. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
Jul 11 2016
Lan, can you follow up on this? From the instructions (https://chromium.googlesource.com/chromium/src/+/master/tools/perf/docs/perf_regression_sheriffing.md): "After your shift, please try to follow up on the bugs you filed weekly. Kick off new bisects if the previous ones failed, and if the bisect picks a likely culprit follow up to ensure the CL author addresses the problem. If you are certain that a specific CL caused a performance regression, and the author does not have an immediate plan to address the problem, please revert the CL."
,
Jul 22 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9006403702458092528
,
Jul 22 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@401521 2.2032 0.0410616 18 good chromium@401544 2.22517 0.0218327 18 bad Bisect job ran on: android_one_perf_bisect Bug ID: 623836 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests thread_times.simple_mobile_sites Test Metric: thread_GPU_cpu_time_per_frame/thread_GPU_cpu_time_per_frame Relative Change: 0.17% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1430 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9006403702458092528 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5817667877863424 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jul 29 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005793967504665472
,
Jul 29 2016
Kicked off another bisect.
,
Jul 29 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@401000 2.0853 0.0471851 18 good chromium@402000 2.12376 0.0674231 18 bad Bisect job ran on: android_one_perf_bisect Bug ID: 623836 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests thread_times.simple_mobile_sites Test Metric: thread_GPU_cpu_time_per_frame/thread_GPU_cpu_time_per_frame Relative Change: 2.89% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1448 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005793967504665472 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5219570420285440 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 5 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005129098837143488
,
Aug 5 2016
Trying a bisect on flickr.com, which is the site that regressed
,
Aug 6 2016
===== BISECT JOB RESULTS ===== Status: failed ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@401440 2.34113 0.13123 5 good chromium@401544 2.79031 0.409062 8 bad Bisect job ran on: android_one_perf_bisect Bug ID: 623836 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests thread_times.simple_mobile_sites Test Metric: thread_GPU_cpu_time_per_frame/https___www.flickr.com_ Relative Change: 16.21% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1492 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005129098837143488 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5774518883188736 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 6 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005116769496430512
,
Aug 6 2016
===== BISECT JOB RESULTS ===== Status: failed ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@401440 2.34113 0.13123 5 good chromium@401544 2.79031 0.409062 8 bad Bisect job ran on: android_one_perf_bisect Bug ID: 623836 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests thread_times.simple_mobile_sites Test Metric: thread_GPU_cpu_time_per_frame/https___www.flickr.com_ Relative Change: 16.21% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1492 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005129098837143488 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5774518883188736 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 7 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005024725650622704
,
Aug 7 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@401521 2.15649 0.0933825 18 good chromium@401544 2.14086 0.067743 18 bad Bisect job ran on: android_one_perf_bisect Bug ID: 623836 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests thread_times.simple_mobile_sites Test Metric: thread_GPU_cpu_time_per_frame/thread_GPU_cpu_time_per_frame Relative Change: 2.17% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1495 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005129098837143488 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5774518883188736 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 18 2016
Perf sheriff ping: reminder to follow up on possible performance issues
,
Aug 19 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9003875572085669408
,
Aug 19 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@401521 2.13362 0.0847163 18 good chromium@401544 2.1513 0.0729632 18 bad Bisect job ran on: android_one_perf_bisect Bug ID: 623836 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests thread_times.simple_mobile_sites Test Metric: thread_GPU_cpu_time_per_frame/thread_GPU_cpu_time_per_frame Relative Change: 0.23% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1542 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9003875572085669408 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=6061555624443904 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Sep 9 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9001963759155007824
,
Sep 10 2016
===== BISECT JOB RESULTS ===== Status: completed ===== SUSPECTED CL(s) ===== Subject : cc: Remove fixed raster scale, stop rasterizing with will-change. Author : vmpstr Commit description: This patch replaces the current behavior of blocking all new scales once the ideal scale changes once. The new behavior looks at a will-change transform property: - If will-change is present, we don't reraster or choose a new scale. - If will-change is absent, we keep rerastering at a new scale. R=danakj@chromium.org, chrishtr@chromium.org BUG= 600867 CQ_INCLUDE_TRYBOTS=tryserver.blink:linux_blink_rel Review-Url: https://codereview.chromium.org/2068413002 Cr-Commit-Position: refs/heads/master@{#401450} Commit : edd476edadbe9b9316f3527b0692836ced4230ce Date : Wed Jun 22 23:16:34 2016 ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@401400 2.08946 0.0317712 12 good chromium@401440 2.05849 0.0450121 18 good chromium@401445 2.08203 0.0402965 27 good chromium@401448 2.08429 0.0332456 27 good chromium@401449 2.05949 0.0247006 5 good chromium@401450 2.17575 0.0905216 18 bad <-- chromium@401460 2.14777 0.0842019 12 bad chromium@401479 2.20358 0.0915979 8 bad chromium@401558 2.15673 0.0663008 12 bad Bisect job ran on: android_one_perf_bisect Bug ID: 623836 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests thread_times.simple_mobile_sites Test Metric: thread_GPU_cpu_time_per_frame/thread_GPU_cpu_time_per_frame Relative Change: 2.40% Score: 99.9 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1612 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9001963759155007824 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=4517899471945728 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you! |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by lanwei@google.com
, Jun 28 2016