Issue metadata
Sign in to add a comment
|
5.1% regression in memory.top_10_mobile at 441047:441145 |
||||||||||||||||||||
Issue descriptionLinks below.
,
Jan 10 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8990898879784492688
,
Jan 10 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_one_perf_bisect Benchmark : memory.top_10_mobile Metric : memory:chrome:all_processes:reported_by_chrome:v8:effective_size_avg/foreground/http_www_amazon_com_gp_aw_s_k_nexus Revision Result N chromium@441046 6606089 +- 743185 21 good chromium@441145 6663237 +- 895076 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http.www.amazon.com.gp.aw.s.k.nexus memory.top_10_mobile Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8990898879784492688 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5891720979415040 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jan 10 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8990830484615567024
,
Jan 10 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_one_perf_bisect Benchmark : memory.top_10_mobile Metric : memory:chrome:all_processes:reported_by_chrome:v8:effective_size_avg/foreground/http_www_amazon_com_gp_aw_s_k_nexus Revision Result N chromium@441046 6525791 +- 627678 21 good chromium@441244 6619378 +- 763705 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http.www.amazon.com.gp.aw.s.k.nexus memory.top_10_mobile Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8990830484615567024 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5875092476657664 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jan 10 2017
This looks like signal, but looking at a longer timeframe, looks like it could also be noise. Given the sigma in the bisect, this is unlikely to be able to be bisected. Do we know where the noise is coming from? Do we need to fix this metric?
,
Jan 11 2017
The memory.top_10_mobile looks super noisy, not really clear if that's really a regression or a false alarm.
,
Jan 11 2017
Juan, do you have anything to say or do we need to talk about how to de-noise this metric?
,
Jan 12 2017
Looks noisy, but the abs value is only about ~320KiB, so it's fine to ignore this alert. Hopefully ongoing work to trigger memory dumps within Chrome (rather than from Telemetry) will help to reduce this noise. +primiano
,
Jan 12 2017
,
Jan 12 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8990677938383245664
,
Jan 12 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8990677920999313024
,
Jan 12 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8990677877984265792
,
Jan 12 2017
well the problem here is that the regression range is large, there are 5-6 v8 rolls in the range, and metric in this page is noisy. I tried kicking some bisects around the v8 rolls but very likely this is gone.
,
Jan 12 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_one_perf_bisect Benchmark : memory.top_10_mobile Metric : memory:chrome:all_processes:reported_by_chrome:v8:effective_size_avg/foreground/http_www_amazon_com_gp_aw_s_k_nexus Revision Result N chromium@441110 6694462 +- 673829 20 good chromium@441111 6671456 +- 703229 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http.www.amazon.com.gp.aw.s.k.nexus memory.top_10_mobile Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8990677920999313024 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5796532290322432 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jan 12 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_one_perf_bisect Benchmark : memory.top_10_mobile Metric : memory:chrome:all_processes:reported_by_chrome:v8:effective_size_avg/foreground/http_www_amazon_com_gp_aw_s_k_nexus Revision Result N chromium@441130 6732477 +- 752444 21 good chromium@441131 6771664 +- 692266 20 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http.www.amazon.com.gp.aw.s.k.nexus memory.top_10_mobile Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8990677938383245664 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5807163944992768 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jan 12 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_one_perf_bisect Benchmark : memory.top_10_mobile Metric : memory:chrome:all_processes:reported_by_chrome:v8:effective_size_avg/foreground/http_www_amazon_com_gp_aw_s_k_nexus Revision Result N chromium@441099 6735774 +- 782498 21 good chromium@441100 6784225 +- 722372 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http.www.amazon.com.gp.aw.s.k.nexus memory.top_10_mobile Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8990677877984265792 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5847885603667968 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jan 12 2017
Alright, thanks for following up.
,
Apr 11 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8982580635639389344
,
Apr 11 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8982576271582634336 |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by benhenry@google.com
, Jan 10 2017