Issue metadata
Sign in to add a comment
|
170.6% regression in page_cycler_v2.tough_layout_cases at 464923:464949 |
||||||||||||||||||||||||
Issue descriptionThere is no change to this benchmark. Wonder whether this is due to a device swap.
,
Apr 21 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8981667161025577872
,
Apr 21 2017
,
Apr 21 2017
Looks like it's the same device. https://luci-logdog.appspot.com/v/?s=chrome%2Fbb%2Fchromium.perf%2FAndroid_Nexus6_Perf__2_%2F5600%2F%2B%2Frecipes%2Fsteps%2Fpage_cycler_v2.tough_layout_cases%2F0%2Fstdout vs https://luci-logdog.appspot.com/v/?s=chrome%2Fbb%2Fchromium.perf%2FAndroid_Nexus6_Perf__2_%2F5599%2F%2B%2Frecipes%2Fsteps%2Fpage_cycler_v2.tough_layout_cases%2F0%2Fstdout
,
Apr 21 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_nexus6_perf_bisect Benchmark : page_cycler_v2.tough_layout_cases Metric : benchmark_duration/benchmark_duration Revision Result N chromium@464922 0.0506119 +- 0.0179521 21 good chromium@464949 0.0489868 +- 0.0198141 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=benchmark.duration page_cycler_v2.tough_layout_cases Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8981667161025577872 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5816118486237184 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Apr 21 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8981662045033715664
,
Apr 21 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_nexus6_perf_bisect Benchmark : page_cycler_v2.tough_layout_cases Metric : benchmark_duration/benchmark_duration Revision Result N chromium@464922 0.0506119 +- 0.0179521 21 good chromium@464949 0.0489868 +- 0.0198141 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=benchmark.duration page_cycler_v2.tough_layout_cases Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8981662045033715664 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5816118486237184 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Apr 22 2017
+Simon seems like the nexus 6 bisect bot is failing?
,
Apr 22 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8981570463256259360
,
Apr 23 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_nexus6_perf_bisect Benchmark : page_cycler_v2.tough_layout_cases Metric : benchmark_duration/benchmark_duration Revision Result N chromium@464922 0.0496648 +- 0.0213437 21 good chromium@464949 0.0494344 +- 0.0189344 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=benchmark.duration page_cycler_v2.tough_layout_cases Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8981570463256259360 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5816118486237184 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Apr 24 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8981423185856876736
,
Apr 24 2017
Rekicked this bisect, guessing that if you want to bisect on benchmark duration you don't want to supply a story filter.
,
Apr 25 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_nexus6_perf_bisect Benchmark : page_cycler_v2.tough_layout_cases Metric : benchmark_duration/benchmark_duration Revision Result N chromium@464922 14.6189 +- 0.639905 21 good chromium@464949 14.6759 +- 1.2981 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests page_cycler_v2.tough_layout_cases Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8981423185856876736 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5898030491893760 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Apr 25 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8981380073384321536
,
Apr 25 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_nexus6_perf_bisect Benchmark : page_cycler_v2.tough_layout_cases Metric : benchmark_duration/benchmark_duration Revision Result N chromium@464922 13.3994 +- 5.22171 21 good chromium@464949 13.5569 +- 0.81519 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests page_cycler_v2.tough_layout_cases Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8981380073384321536 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5898030491893760 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Apr 25 2017
Oh, looking at the "battery temperature", I also find that the regression are probably due to the device being hot. Before: https://luci-logdog.appspot.com/v/?s=chrome%2Fbb%2Fchromium.perf%2FAndroid_Nexus6_Perf__2_%2F5574%2F%2B%2Frecipes%2Fsteps%2Fpage_cycler_v2.tough_layout_cases%2F0%2Fstdout battery temperature: 260 - 270 After: https://luci-logdog.appspot.com/v/?s=chrome%2Fbb%2Fchromium.perf%2FAndroid_Nexus6_Perf__2_%2F5602%2F%2B%2Frecipes%2Fsteps%2Fpage_cycler_v2.tough_layout_cases%2F0%2Fstdout battery temperature: 340 - 350
,
Apr 25 2017
,
Apr 26 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8981244287448465792
,
Apr 27 2017
=== Auto-CCing suspected CL author paezagon@chromium.org === Hi paezagon@chromium.org, the bisect results pointed to your CL, please take a look at the results. === BISECT JOB RESULTS === Perf regression found with culprit Suspected Commit Author : paezagon Commit : ae360640e5b0475e52f8cee25d755ce484faf6e4 Date : Mon Apr 17 17:49:09 2017 Subject: Working on making context menu display the number of bookmarks that will be opened by by Open All. Bisect Details Configuration: android_nexus6_perf_bisect Benchmark : page_cycler_v2.tough_layout_cases Metric : benchmark_duration/benchmark_duration Change : 2.39% | 14.7507624904 -> 14.3987812224 Revision Result N chromium@464922 14.7508 +- 0.453432 21 good chromium@464936 14.8684 +- 1.15515 21 good chromium@464943 14.7814 +- 0.301628 14 good chromium@464946 14.8637 +- 0.200109 6 good chromium@464948 14.8856 +- 0.698457 9 good chromium@464949 14.3988 +- 3.68308 14 bad <-- To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests page_cycler_v2.tough_layout_cases Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8981244287448465792 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5898030491893760 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Apr 30 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8980930211023908192
,
Apr 30 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_nexus6_perf_bisect Benchmark : page_cycler_v2.tough_layout_cases Metric : benchmark_duration/benchmark_duration Revision Result N chromium@464922 13.6284 +- 0.764554 21 good chromium@464949 13.5545 +- 0.543683 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests page_cycler_v2.tough_layout_cases Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8980930211023908192 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5816118486237184 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you! |
|||||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||||
Comment 1 by nedngu...@google.com
, Apr 21 2017