New issue
Advanced search Search tips

Issue 714389 link

Starred by 0 users
Status: WontFix
Owner: ----
Closed: Apr 2017
Cc:
johnchen@chromium.org
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

2.4%-163.1% regression in media.tough_video_cases at 466069:466269

Project Member Reported by zhanliang@google.com, Apr 22 2017 
See the link to graphs below.

Comment 1 by zhanliang@google.com, Apr 22 2017 

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=714389

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4omP9goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4oKV9AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4qDnqQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4u2CtAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4ou19wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4ou1twsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4tqe8wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgorfRsQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4rrRoQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4uq-pwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4pyN-goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgoqvgvwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgouuYrQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgorfRsQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgovPpvgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4r6WowsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4v7FoAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgooCn3wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4pTOtQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4pTOtQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4pz_tgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgov6AtAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgoouw6AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgop3Z_AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4o2w4AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgorO18gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4tm6qwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgorPLqwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwv_hjAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg4vq5vAoM


Bot(s) for this bug's original alert(s):

chromium-rel-mac11-pro
chromium-rel-win10
chromium-rel-win7-dual
chromium-rel-win7-x64-dual
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Apr 22 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_pro_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : buffering_time/video.html?src_crowd.ogg_type_audio

Revision             Result                  N
chromium@466068      89.9445 +- 188.919      21      good
chromium@466205      89.7517 +- 189.098      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.crowd.ogg.type.audio media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981592034941364432

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5197084715646976


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 5 by 42576172...@developer.gserviceaccount.com, Apr 22 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_pro_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : buffering_time/video.html?src_crowd.ogg_type_audio

Revision             Result                  N
chromium@466068      89.8764 +- 190.363      21      good
chromium@466205      89.5293 +- 188.062      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.crowd.ogg.type.audio media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981582699486931904

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5197084715646976


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Apr 24 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_retina_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : time_to_play/crowd.ogg

Revision             Result                  N
chromium@466061      33.7383 +- 3.53176      21      good
chromium@466200      37.9771 +- 36.8172      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981485621321102864

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5197084715646976


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Comment 8 by simonhatch@chromium.org, Apr 24 2017 

On a lot of the graphs that you tried to bisect, the ref moved nearly in lockstep with the regression. That usually means something about the testing environment changed and you can ignore the regression/

Comment 9 by johnchen@chromium.org, Apr 24 2017

Status: WontFix (was: Untriaged)
Project Member

Comment 11 by 42576172...@developer.gserviceaccount.com, May 1 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_retina_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : time_to_play/video.html?src_crowd.ogg_type_audio

Revision             Result                 N
chromium@466061      40.675 +- 59.62        21      good
chromium@466200      40.664 +- 58.7124      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.crowd.ogg.type.audio media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8980830238798476384

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5197084715646976


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
►

Sign in to add a comment