Issue metadata
Sign in to add a comment
|
1.8% regression in system_health.memory_mobile at 427680:427783 |
||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Nov 2 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8997112763941095392
,
Nov 3 2016
===== BISECT JOB RESULTS ===== Status: failed ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@427679 15340815 58373.5 14 good chromium@427783 15415725 34315.3 12 bad Bisect job ran on: android_nexus7_perf_bisect Bug ID: 661487 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests system_health.memory_mobile Test Metric: memory:chrome:all_processes:reported_by_os:system_memory:native_heap:proportional_resident_size_avg/blank_about/blank_about_blank Relative Change: 0.31% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_perf_bisect/builds/3441 Job details: https://chromeperf.appspot.com/buildbucket_job_status/8997112763941095392 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=4857174495330304 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Nov 4 2016
Chrome is crashing on this page, both at the start and end revision: https://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_perf_bisect/builds/3441/steps/Gathering%20reference%20values.Performance%20Test%205%20of%205%20%282%29/logs/Failure%20Output Also looks like the graph is pretty noisy around the alert. Not sure how much we can do here.
,
Nov 4 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8996895146224529120
,
Nov 4 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@427679 15370641 42143.8 18 good chromium@427783 15404262 45671.8 18 bad Bisect job ran on: android_nexus7_perf_bisect Bug ID: 661487 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=blank.about.blank system_health.memory_mobile Test Metric: memory:chrome:all_processes:reported_by_os:system_memory:native_heap:proportional_resident_size_avg/blank_about/blank_about_blank Relative Change: 0.18% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_perf_bisect/builds/3451 Job details: https://chromeperf.appspot.com/buildbucket_job_status/8996895146224529120 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=6484015899475968 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Feb 3 2017
These regressions happened before M56 branch. M56 is now in stable. These regressions made it to the stable channel. Marking wontfix.
,
Mar 14 2017
,
Mar 22 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8984378659442434800
,
Mar 24 2017
=== BISECT JOB RESULTS ===
Bisect failed unexpectedly
Bisect was aborted with the following:
Infra Failure: Step('device_status (3)') returned 1
Bisect Details
Configuration: android_nexus7_perf_bisect
Benchmark : system_health.memory_mobile
Metric : memory:chrome:all_processes:reported_by_os:system_memory:native_heap:proportional_resident_size_avg/blank_about/blank_about_blank
Revision Result N
chromium@427679 15360065 +- 293926 11 good
chromium@427783 15423491 +- 216251 9 bad
Please refer to the following doc on diagnosing memory regressions:
https://chromium.googlesource.com/chromium/src/+/master/docs/memory-infra/memory_benchmarks.md
To Run This Test
src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests system_health.memory_mobile
Debug Info
https://chromeperf.appspot.com/buildbucket_job_status/8984378659442434800
Is this bisect wrong?
https://chromeperf.appspot.com/bad_bisect?try_job_id=4857174495330304
| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
| X | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection. Thank you!
,
Mar 30 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8983687462701122432
,
Mar 30 2017
=== BISECT JOB RESULTS === Perf regression found but unable to continue Bisect was stopped because a commit couldn't be classified as either good or bad. Bisect Details Configuration: android_nexus7_perf_bisect Benchmark : system_health.memory_mobile Metric : memory:chrome:all_processes:reported_by_os:system_memory:native_heap:proportional_resident_size_avg/blank_about/blank_about_blank Revision Result N chromium@427679 15374924 +- 146148 21 good chromium@427731 15375411 +- 217417 21 unknown chromium@427783 15417834 +- 200888 21 bad Please refer to the following doc on diagnosing memory regressions: https://chromium.googlesource.com/chromium/src/+/master/docs/memory-infra/memory_benchmarks.md To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=blank.about.blank system_health.memory_mobile Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8983687462701122432 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=4857174495330304 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you! |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by primiano@chromium.org
, Nov 2 2016