Issue metadata
Sign in to add a comment
|
3% memory regression in page_cycler.intl_ar_fa_he at 396504:396534 |
||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
May 31 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@396503 30772.2 2985.53 9 good chromium@396534 34104.2 6300.19 12 bad Bisect job ran on: android_nexus5_perf_bisect Bug ID: 616077 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests page_cycler.intl_ar_fa_he Test Metric: vm_private_dirty_final_renderer/vm_private_dirty_final_renderer Relative Change: 0.32% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/3708 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9011147083711987184 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5846314105962496 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
May 31 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@396503 29617.2 117.766 9 good chromium@396534 31281.7 4403.18 12 bad Bisect job ran on: android_nexus5_perf_bisect Bug ID: 616077 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests page_cycler.intl_ar_fa_he Test Metric: vm_private_dirty_final_renderer/vm_private_dirty_final_renderer Relative Change: 0.28% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/3707 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9011147095137126256 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5892181303230464 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jul 6 2016
The only clear alert associated with this bug is https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg7OuSsgkM -- started one more bisect job there; if it fails to reproduce anything, then this bug should probably be closed.
,
Jul 6 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@396502 33633.8 153.185 9 good chromium@396531 34291.3 2564.47 12 bad Bisect job ran on: android_nexus6_perf_bisect Bug ID: 616077 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests page_cycler.intl_ar_fa_he Test Metric: vm_private_dirty_final_renderer/vm_private_dirty_final_renderer Relative Change: 0.37% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus6_perf_bisect/builds/2294 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9007865167173357920 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5840247309467648 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jul 7 2016
Moving this nonessential bug to the next milestone. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
Jul 19 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9006686568819969200
,
Jul 19 2016
Kicked another bisect for one page that shows the regression and has a reasonable stddev i.e., vm_private_dirty_final_renderer / http___msn.co.il_
,
Jul 19 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@396502 35374.3 90.3037 12 good chromium@396531 35361.4 67.8253 8 bad Bisect job ran on: android_nexus6_perf_bisect Bug ID: 616077 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests page_cycler.intl_ar_fa_he Test Metric: vm_private_dirty_final_renderer/http___msn.co.il_ Relative Change: 0.02% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus6_perf_bisect/builds/2320 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9006686568819969200 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5316380669247488 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 5 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005131844783450976
,
Aug 6 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@396502 40480.7 6525.33 9 good chromium@396531 44024.5 7169.67 12 bad Bisect job ran on: android_nexus6_perf_bisect Bug ID: 616077 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests page_cycler.intl_ar_fa_he Test Metric: vm_private_dirty_final_renderer/vm_private_dirty_final_renderer Relative Change: 13.47% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus6_perf_bisect/builds/2432 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005131844783450976 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5823051208327168 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 6 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005040583557766304
,
Aug 7 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@396502 33643.1 92.6842 9 good chromium@396531 33553.5 121.145 12 bad Bisect job ran on: android_nexus6_perf_bisect Bug ID: 616077 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests page_cycler.intl_ar_fa_he Test Metric: vm_private_dirty_final_renderer/vm_private_dirty_final_renderer Relative Change: 0.12% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus6_perf_bisect/builds/2434 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005040583557766304 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5796218802798592 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 17 2016
Bisect repeatedly failed to reproduce. Note that ref results did change at the same time as test results, but not in exactly the same way. This still suggests that the change was caused by a change in the test runner machine, not in Chrome, I think. Closing, please re-open if you think this is worth investigating further. |
|||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||
Comment 1 by primiano@chromium.org
, May 31 2016