Issue metadata
Sign in to add a comment
|
9.9% regression in speedometer at 465664:465687 |
||||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Apr 20 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8981813987254000096
,
Apr 20 2017
,
Apr 21 2017
=== BISECT JOB RESULTS === Bisect failed for unknown reasons Please contact the team (see below) and report the error. Bisect Details Configuration: android_webview_nexus6_aosp_perf_bisect Benchmark : speedometer Metric : benchmark_duration/benchmark_duration To Run This Test src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests speedometer Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8981813987254000096 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=6334716057223168 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Apr 21 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8981693354923582560
,
Apr 23 2017
=== BISECT JOB RESULTS === Bisect failed for unknown reasons Please contact the team (see below) and report the error. Bisect Details Configuration: android_webview_nexus6_aosp_perf_bisect Benchmark : speedometer Metric : benchmark_duration/benchmark_duration To Run This Test src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests speedometer Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8981693354923582560 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=6334716057223168 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Apr 24 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8981440767338235936
,
Apr 25 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_webview_nexus6_aosp_perf_bisect Benchmark : speedometer Metric : benchmark_duration/benchmark_duration Revision Result N chromium@465663 1.76652 +- 0.0934675 21 good chromium@465687 1.7622 +- 0.0637897 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests speedometer Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8981440767338235936 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=6334716057223168 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Apr 27 2017
Seems to be a broken bisect again. The current behavior is strange, the duration doubled and ref stopped completely. What is going on?
,
Apr 27 2017
Looking at https://build.chromium.org/p/chromium.perf/builders/Android%20Nexus6%20WebView%20Perf%20%283%29/builds/3012, the ref build are no longer running. I filed a bug in issue 715977
,
Apr 27 2017
For this bug, I would ignore a small regression of 1.85 minutes --> 2.05 minutes (12seconds)
,
Apr 27 2017
martiniss, mikecase: I think this change may actually be caused by the webview bots being fixed (they had accidentally been running chrome). How could we tell? simonhatch: can you look into the failed bisect?
,
Apr 27 2017
#12: We can tell by the bisect data? If bisect says before & after regressions have same results, then it must be due to infra change.
,
Apr 27 2017
Was failing device_status, latest run appears to be working. Couldn't find a bug associated with fixing the failures though.
,
Apr 27 2017
re comment 12, 13: Yeah, all the WebView bisect issues were in recipe/infra code. Bisects use the latest version of that code always, so basically, if the issue shows up in bisect its probably a real issue. If it doesnt show up in bisect, this regression was probably caused by infra.
,
May 2 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8980663184020685472
,
May 3 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: android_webview_nexus6_aosp_perf_bisect Benchmark : speedometer Metric : benchmark_duration/benchmark_duration Revision Result N chromium@465663 1.76652 +- 0.0934675 21 good chromium@465687 1.7622 +- 0.0637897 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests speedometer Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8980663184020685472 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=6334716057223168 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Jul 19 2017
,
Jul 29 2017
,
Jul 29 2017
,
Sep 18 2017
Recovered since then. |
|||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||
Comment 1 by jarin@google.com
, Apr 20 2017