Issue metadata
Sign in to add a comment
|
1.3% regression in jetstream at 408108:408137 |
||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Aug 1 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005542195859890768
,
Aug 1 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@408107 177.778 0.646762 18 good chromium@408137 177.889 0.6764 18 bad Bisect job ran on: mac_10_11_perf_bisect Bug ID: 633113 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests jetstream Test Metric: Score/Score Relative Change: 0.11% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_10_11_perf_bisect/builds/787 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005542195859890768 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5260934512115712 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 1 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005533484679632640
,
Aug 1 2016
Trying another bisect.
,
Aug 1 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005521309046799152
,
Aug 1 2016
===== BISECT JOB RESULTS ===== Status: failed ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@408200 174.6 0.547723 5 bad Bisect job ran on: mac_10_11_perf_bisect Bug ID: 633113 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests jetstream Test Metric: Score/Score Relative Change: None Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_10_11_perf_bisect/builds/788 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005533484679632640 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5264058027081728 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 1 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005518239604106704
,
Aug 1 2016
Trying again.
,
Aug 1 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@408100 175.667 1.23669 18 good chromium@408140 176.611 0.916444 18 bad Bisect job ran on: mac_10_11_perf_bisect Bug ID: 633113 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests jetstream Test Metric: Score/Score Relative Change: 0.68% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_10_11_perf_bisect/builds/790 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005518239604106704 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=6456946069078016 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 2 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005436066146463472
,
Aug 2 2016
:( Bisect bot having a hard time with this. Trying a really wide bisect.
,
Aug 2 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005430148205855792
,
Aug 2 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@408107 177.722 0.95828 18 good chromium@408137 177.278 0.894792 18 bad Bisect job ran on: mac_10_11_perf_bisect Bug ID: 633113 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests jetstream Test Metric: Score/Score Relative Change: 0.00% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_10_11_perf_bisect/builds/799 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005533484679632640 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5264058027081728 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 2 2016
===== BISECT JOB RESULTS ===== Status: completed ===== SUSPECTED CL(s) ===== Subject : Turn on enable begin frame scheduling by default Author : enne Commit description: This turns on --enable-begin-frame-scheduling for all platforms but mus and Blimp. This change means browser->renderer begin frame ticks instead of sending vsync information and having a synthetic source on the renderer side. This feature was already on for Android so should only be a real change for desktop / ChromeOS platforms. Lots of cleanup can follow from this like removing all commit vsync / authoritative vsync / CompositorVSyncManager things, but this is a smaller patch to suss out any performance regressions. This previously landed and regressed a number of metrics. Some of these have been investigated and fixed and the rest are WontFix. CQ_INCLUDE_TRYBOTS=tryserver.blink:linux_blink_rel Review-Url: https://codereview.chromium.org/1939253002 Cr-Commit-Position: refs/heads/master@{#408172} Commit : d020d554c9ffc0476d43f5364a47c522b64e3d9a Date : Wed Jul 27 17:45:34 2016 ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@407000 178.2 0.83666 5 good chromium@408006 177.5 0.755929 8 good chromium@408131 177.625 0.916125 8 good chromium@408162 177.167 0.717741 12 good chromium@408170 176.833 1.4668 12 good chromium@408171 177.0 0.707107 5 good chromium@408172 175.583 0.792961 12 bad <-- chromium@408174 175.375 0.744024 8 bad chromium@408178 175.25 1.0351 8 bad chromium@408193 175.5 0.92582 8 bad chromium@408255 175.6 0.547723 5 bad chromium@408503 175.875 0.64087 8 bad chromium@409000 175.2 0.447214 5 bad Bisect job ran on: mac_10_11_perf_bisect Bug ID: 633113 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests jetstream Test Metric: Score/Score Relative Change: 1.68% Score: 98.0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_10_11_perf_bisect/builds/798 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005436066146463472 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5849742450360320 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you! |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by alexclarke@chromium.org
, Aug 1 2016