Issue metadata
Sign in to add a comment
|
5.6% regression in dromaeo.domcoremodify at 388924:388951 |
||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Apr 25 2016
cc test owners
,
Apr 25 2016
bisect failed with "Exception steps exception device_status_check". kicked another run.
,
Apr 25 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Value Std. Dev. Num Values Good? chromium@388937 1135.44674 14.893755 18 good chromium@388951 1136.618322 9.683083 18 bad Bisect job ran on: linux_perf_bisect Bug ID: 606252 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests dromaeo.domcoreattr Test Metric: dom/dom Relative Change: 0.36% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/linux_perf_bisect/builds/6453 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9014424383885074064 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=606252 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Apr 25 2016
trying another bisect with a wide range.
,
Apr 25 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Value Std. Dev. Num Values Good? chromium@388937 1137.53879 8.395452 18 good chromium@388979 1133.100414 19.253142 18 bad Bisect job ran on: linux_perf_bisect Bug ID: 606252 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests dromaeo.domcoreattr Test Metric: dom/dom Relative Change: 0.19% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/linux_perf_bisect/builds/6454 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9014418770824011728 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=606252 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Apr 25 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Value Std. Dev. Num Values Good? chromium@388937 1132.29618 12.643433 18 good chromium@388979 1133.454762 16.400066 18 bad Bisect job ran on: linux_perf_bisect Bug ID: 606252 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests dromaeo.domcoreattr Test Metric: dom/dom Relative Change: 1.17% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/linux_perf_bisect/builds/6455 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9014414549835073120 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=606252 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Apr 25 2016
Strange, the ref build didn't move but 3 bisects failed to reproduce on linux. I kicked off another build on N7, where it also regressed, but with a wider range since it's not clear exactly where the regression was: https://chromeperf.appspot.com/buildbucket_job_status/9014406636243033776
,
May 6 2016
Last bisect failed. Kick off another one at https://chromeperf.appspot.com/buildbucket_job_status/9013373449174101792
,
May 6 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@388900 1132.05 11.8269 18 good chromium@388979 1131.42 12.5393 18 bad Bisect job ran on: linux_perf_bisect Bug ID: 606252 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests dromaeo.domcoreattr Test Metric: dom/dom Relative Change: 0.04% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/linux_perf_bisect/builds/6477 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9013373449174101792 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5875228480110592 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
May 12 2016
Previous bisect couldn't find any regression, expanded revision range and re-kicked another bisect: http://build.chromium.org/p/tryserver.chromium.perf/builders/linux_perf_bisect/builds/6493
,
May 12 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@388930 1141.09 14.4009 18 good chromium@388980 1132.25 15.5203 18 bad Bisect job ran on: linux_perf_bisect Bug ID: 606252 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests dromaeo.domcoreattr Test Metric: dom/dom Relative Change: 0.84% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/linux_perf_bisect/builds/6493 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9012831766364123792 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5826037263368192 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
May 13 2016
This should be a kind of noise. |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by toyoshim@chromium.org
, Apr 25 2016