Issue metadata
Sign in to add a comment
|
10.3% regression in system_health.memory_desktop at 405052:405095 |
||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Jul 15 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9007060487332802336
,
Jul 15 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@405051 4609365 215252 12 good chromium@405095 4631211 211593 12 bad Bisect job ran on: mac_10_11_perf_bisect Bug ID: 628637 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_desktop Test Metric: load_news-memory:chrome:all_processes:reported_by_chrome:blink_gc:effective_size_avg/load_news_qq Relative Change: 2.23% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_10_11_perf_bisect/builds/742 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9007060487332802336 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5841505181237248 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jul 18 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9006791405258185056
,
Jul 18 2016
,
Jul 18 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@405053 259233 1184.2 12 good chromium@405180 243578 60833.5 12 bad Bisect job ran on: mac_retina_perf_bisect Bug ID: 628637 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_desktop Test Metric: load_social-memory:chrome:all_processes:reported_by_chrome:dom_storage:effective_size_avg/load_social_facebook Relative Change: 1.27% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_retina_perf_bisect/builds/1425 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9006791405258185056 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5841359353675776 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jul 19 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9006717625693717568
,
Jul 19 2016
,
Aug 5 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005150814945070480
,
Aug 6 2016
===== BISECT JOB RESULTS ===== Status: completed ===== SUSPECTED CL(s) ===== Subject : Add benchmark that imitates news reading. Author : ulan Commit description: Each story in the benchmark does the following: 1. Load the main page. 2. Open and scroll the first news item. 3. Go back to the main page and scroll it. 4. Open and scroll the second news item. 5. Go back to the main page and scroll it. 6. etc. This workflow is interesting because it is close to real world and generates a lot of garbage by creating and discarding pages. A couple of websites crash with OOM on svelte device, so by tracking and optimizing for this benchmark we can improve user experience on low-memory devices. *** NOTE TO SHERRIF *** Regressions are expected in system_health.memory_mobile and system_health.memory_desktop for the following stories: - load:news:cnn - load:social:facebook - load:news:qq - load:news:reddit - load:social:twitter If there are failing tests in form of benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.* please do not revert this CL but instead disabling failing test by adding them into the _DISABLE_TESTS list in tools/perf/benchmarks/system_health_smoke_test.py BUG=589726 CQ_INCLUDE_TRYBOTS=tryserver.chromium.perf:android_s5_perf_cq;tryserver.chromium.perf:mac_retina_perf_cq Review-Url: https://codereview.chromium.org/2118293002 Cr-Commit-Position: refs/heads/master@{#405212} Commit : 5b1847df818e5be4592e9a6ac4832350bb663023 Date : Wed Jul 13 17:39:28 2016 ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@405051 4456448 0.0 5 good chromium@405136 4535091 175852 5 good chromium@405178 4613734 215373 5 good chromium@405199 4613734 215373 5 good chromium@405210 4797235 71791.1 5 good chromium@405211 4561306 215373 5 good chromium@405212 4915264 0.0 5 bad <-- chromium@405213 4915264 0.0 5 bad chromium@405215 4915264 0.0 5 bad chromium@405220 4915264 0.0 5 bad Bisect job ran on: mac_10_11_perf_bisect Bug ID: 628637 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_desktop Test Metric: load_news-memory:chrome:all_processes:reported_by_chrome:blink_gc:effective_size_avg/load_news_qq Relative Change: 10.30% Score: 95.0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_10_11_perf_bisect/builds/816 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005150814945070480 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5785438032232448 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 30 2016
,
Aug 30 2016
|
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by petrcermak@chromium.org
, Jul 15 2016