New issue
Advanced search Search tips

Issue 714392 link

Starred by 0 users
Status: WontFix
Owner: ----
Closed: Apr 2017
Cc:
johnchen@chromium.org
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

5.8%-960.7% regression in media.tough_video_cases at 465627:465860

Project Member Reported by zhanliang@google.com, Apr 22 2017 
See the link to graphs below.
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Apr 22 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: winx64_zen_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : energy_consumption_mwh/video.html?src_crowd1080_vp9.webm_canvas_true

Revision             Result                  N
chromium@465666      15.2653 +- 8.25986      21      good
chromium@465860      14.8334 +- 1.49308      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.crowd1080.vp9.webm.canvas.true media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981591498110498976

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5263127219798016


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 5 by 42576172...@developer.gserviceaccount.com, Apr 22 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: winx64_zen_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : energy_consumption_mwh/video.html?src_crowd1080_vp9.webm_canvas_true

Revision             Result                  N
chromium@465666      15.5327 +- 10.5229      21      good
chromium@465860      14.9078 +- 6.7856       21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.crowd1080.vp9.webm.canvas.true media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981582572548269344

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5263127219798016


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Apr 23 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: winx64_zen_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : vm_working_set_delta_size/video.html?src_tulip2.vp9.webm

Revision             Result                  N
chromium@465666      29434.1 +- 9555.85      21      good
chromium@465860      28153.9 +- 6899.83      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.tulip2.vp9.webm media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981485504771947920

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5263127219798016


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, Apr 25 2017 


=== BISECT JOB RESULTS ===
Bisect was unable to run to completion

Error: INFRA_FAILURE

The bisect was able to narrow the range, you can try running with:
  good_revision: e51782890830ad8e709199ad65ce66e52af90441
  bad_revision : 3b92d36f19d01005f2416e73f64addaa7f42c422

If failures persist contact the team (see below) and report the error.


Bisect Details
  Configuration: mac_10_11_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : idle_wakeups/video.html?src_crowd1080_vp9.webm_canvas_true

Revision             Result                  N
chromium@465330      207.447 +- 8.32465      6      good
chromium@465557      208.989 +- 4.7187       6      good
chromium@465670      207.854 +- 5.88971      6      good
chromium@465699      205.823 +- 3.07166      6      good
chromium@465727      200.936 +- 4.03452      6      bad
chromium@465783      201.572 +- 4.98494      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981406416867054192

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4942506669637632


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 11 by 42576172...@developer.gserviceaccount.com, Apr 25 2017 


=== BISECT JOB RESULTS ===
Bisect was unable to run to completion

Error: INFRA_FAILURE

The bisect was able to narrow the range, you can try running with:
  good_revision: 52558bf8b2796a8e97c73a2351e23a1f8c45e423
  bad_revision : 211430bf1dc94f392d736cd02a3eed95b9f6dfaa

If failures persist contact the team (see below) and report the error.


Bisect Details
  Configuration: mac_10_11_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : idle_wakeups/video.html?src_crowd1080_vp9.webm_canvas_true

Revision             Result                  N
chromium@465330      209.328 +- 7.22095      9      good
chromium@465557      201.719 +- 49.0415      9      good
chromium@465670      206.647 +- 5.90015      6      good
chromium@465783      200.139 +- 6.98046      9      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981384390041333440

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4942506669637632


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 13 by 42576172...@developer.gserviceaccount.com, Apr 26 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: winx64_zen_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : vm_working_set_delta_size/tulip2.vp9.webm_total

Revision             Result                  N
chromium@465666      29549.8 +- 7165.33      20      good
chromium@465860      28685.1 +- 6631.81      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981261518690347344

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4942506669637632


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 15 by 42576172...@developer.gserviceaccount.com, Apr 28 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: winx64_zen_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : vm_working_set_delta_size/crowd720_vp9.webm_gpu

Revision             Result                   N
chromium@465666      -3065.33 +- 3262.24      21      good
chromium@465860      -2674.67 +- 1895.93      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981123150940810832

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4950646303752192


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 17 by 42576172...@developer.gserviceaccount.com, Apr 28 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: winx64_zen_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : vm_working_set_delta_size/crowd720_vp9.webm_gpu

Revision             Result                  N
chromium@465666      -2399.2 +- 8395.32      20      good
chromium@465860      -2541.9 +- 6709.97      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981091336129878256

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4950646303752192


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Comment 18 by johnchen@chromium.org, Apr 28 2017

Status: WontFix (was: Untriaged)
Bisect wasn't able to find the regression after repeated attempts, and the data were too noisy.
Project Member

Comment 20 by 42576172...@developer.gserviceaccount.com, Apr 29 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: winx64_zen_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : vm_working_set_delta_size/tulip2.vp9.webm_total

Revision             Result                  N
chromium@465666      29179.6 +- 7392.75      20      good
chromium@465860      28486.5 +- 6837.82      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8980969720447869072

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4950646303752192


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 22 by 42576172...@developer.gserviceaccount.com, May 1 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: winx64_zen_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : vm_working_set_delta_size/video.html?src_tulip2.vp9.webm

Revision             Result                  N
chromium@465666      28907.2 +- 10087.8      21      good
chromium@465860      29530.7 +- 12174.8      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.tulip2.vp9.webm media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8980843164602628528

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5263127219798016


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
►

Sign in to add a comment