Issue metadata
Sign in to add a comment
|
1.9% regression in media.tough_video_cases_extra at 426023:426075 |
||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Oct 21 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8998177478305391312
,
Oct 21 2016
=== Auto-CCing suspected CL author skym@chromium.org === Hi skym@chromium.org, the bisect results pointed to your CL below as possibly causing a regression. Please have a look at this info and see whether your CL be related. ===== BISECT JOB RESULTS ===== Status: completed ===== SUSPECTED CL(s) ===== Subject : Fixing bad cleanup of multi part flag #endifs. Author : skym Commit description: BUG= Review-Url: https://codereview.chromium.org/2432453002 Cr-Commit-Position: refs/heads/master@{#426036} Commit : 7248671d1809b1ba654f478490ced3e9cfa52945 Date : Tue Oct 18 20:45:33 2016 ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@426022 910.42 1.31873 5 good chromium@426029 911.869 1.16898 5 good chromium@426033 910.183 1.70697 5 good chromium@426035 911.618 1.17967 5 good chromium@426036 921.955 6.76438 5 bad <-- chromium@426049 918.718 5.74479 5 bad chromium@426075 915.348 2.81395 8 bad Bisect job ran on: winx64intel_perf_bisect Bug ID: 658282 Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases_extra Test Metric: seek/video.html?src_garden2_10s.mp4 Relative Change: 0.45% Score: 98.0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64intel_perf_bisect/builds/1213 Job details: https://chromeperf.appspot.com/buildbucket_job_status/8998177478305391312 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5827494098239488 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Oct 21 2016
I'm skeptical my change affected this. All I did was change comments, and combine two #if define(OS_CHROMEOS) blocks. I don't see how it could have had a perf impact.
,
Oct 24 2016
indeed. i'll re-run bisect.
,
Oct 24 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8997885992865202848
,
Oct 24 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8997885941919299968
,
Oct 24 2016
Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64intel_perf_bisect/builds/1214 Failure reason: the build has failed. Additional errors: The metric was not found in the test output. Either of the initial "good" or "bad" revisions failed to be tested or built.
,
Oct 24 2016
Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64intel_perf_bisect/builds/1215 Failure reason: the build has failed. Additional errors: The metric was not found in the test output. Either of the initial "good" or "bad" revisions failed to be tested or built.
,
Oct 25 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8997820521760412576
,
Oct 25 2016
Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64intel_perf_bisect/builds/1217 Failure reason: the build has failed. Additional errors: The metric was not found in the test output. Either of the initial "good" or "bad" revisions failed to be tested or built.
,
Nov 18 2016
,
Apr 11 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8982632231270743744
,
Apr 11 2017
=== BISECT JOB RESULTS === NO Perf regression found, tests failed to produce values Bisect Details Configuration: winx64intel_perf_bisect Benchmark : media.tough_video_cases_extra Metric : seek/video.html?src_garden2_10s.mp4 To Run This Test src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter='video\.html\?src.garden2.10s\.mp4' media.tough_video_cases_extra Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8982632231270743744 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5268987422703616 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Apr 25 2017
Since there is an owner, this bug is not untriaged. Updating the status.
,
Apr 25 2017
graph is now ~half what it was, lower is better. |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by liber...@chromium.org
, Oct 21 2016