New issue
Advanced search Search tips

Issue 711866 link

Starred by 1 user
Status: Duplicate
Merged: issue 711496
Owner: ----
Closed: Apr 2017
Cc:
crouleau@chromium.org
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

6.8%-129.4% regression in media.tough_video_cases_extra at 464185:464369

Project Member Reported by crouleau@chromium.org, Apr 15 2017 
This should be a result of my change that fixed this benchmark: https://codereview.chromium.org/2813383002/

Comment 1 by crouleau@chromium.org, Apr 15 2017 

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=711866

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtaa8gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_J2NxQgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggonWtQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwpzPvwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpb2mAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggquD3AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggqaDwgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggrnfkQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwpz-pgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwpie-QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggqqflAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggu-oiAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_I2HpgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpb2-AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtSy_QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggqylqggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpb2uAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggvmnnQgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggv-atwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggoWVxgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggv_QuwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwvLgsAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_O-shwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpGy6ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggsW24AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtmXqwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggsjm0ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggsjmkgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_O-shwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpGyqgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwsiH6QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_I2H-goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggrLo5AsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpGyqgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtjL9QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggqrB8QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwo6i6AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtbQnAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwo6iqAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpqviAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwqrrqgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggvaq9AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_Nv3tQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggvaq9AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggp_Z-gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_L_CgQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwuiC-gsM


Bot(s) for this bug's original alert(s):

chromium-rel-mac-retina
chromium-rel-mac11
chromium-rel-mac11-pro
chromium-rel-win10
chromium-rel-win7-dual
chromium-rel-win7-gpu-ati
chromium-rel-win7-gpu-intel
chromium-rel-win7-gpu-nvidia
chromium-rel-win7-x64-dual
chromium-rel-win8-dual
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Apr 15 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: winx64_10_perf_bisect
  Benchmark    : media.tough_video_cases_extra
  Metric       : seek/video.html?src_tulip2.ogv

Revision             Result                  N
chromium@464227      12.6638 +- 2.41526      21      good
chromium@464322      20.9905 +- 43.1447      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.tulip2.ogv media.tough_video_cases_extra

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982283050323377568

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4965527123918848


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 5 by 42576172...@developer.gserviceaccount.com, Apr 15 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: winx64_10_perf_bisect
  Benchmark    : media.tough_video_cases_extra
  Metric       : seek/video.html?src_tulip2.ogv

Revision             Result                  N
chromium@464227      12.8964 +- 2.15581      21      good
chromium@464322      19.4481 +- 37.3279      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.tulip2.ogv media.tough_video_cases_extra

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982277023937767696

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4965527123918848


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Apr 16 2017

Mergedinto: 711496
Status: Duplicate (was: Untriaged)

=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : crouleau
  Commit : 6a48a45ac9c3138e306f19df0b3fc1974ffe33ec
  Date   : Thu Apr 13 03:55:49 2017
  Subject: Do not play the whole media file before seeking.

Bisect Details
  Configuration: winx64_10_perf_bisect
  Benchmark    : media.tough_video_cases_extra
  Metric       : seek/video.html?src_crowd720_vp9.webm
  Change       : 40.06% | 42.2633333333 -> 59.1933333333

Revision             Result                  N
chromium@464227      42.2633 +- 3.89275      6      good
chromium@464275      42.4408 +- 3.02087      6      good
chromium@464287      43.8692 +- 4.67404      6      good
chromium@464288      64.4317 +- 17.0856      6      bad       <--
chromium@464289      66.3275 +- 14.7559      6      bad
chromium@464290      66.7225 +- 15.8314      6      bad
chromium@464293      67.6933 +- 11.9084      6      bad
chromium@464299      60.3233 +- 16.2542      6      bad
chromium@464322      59.1933 +- 16.4483      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.crowd720.vp9.webm media.tough_video_cases_extra

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982182586600949280

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4965527123918848


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
►

Sign in to add a comment