New issue
Advanced search Search tips

Issue 727631 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 726937
Owner: ----
Closed: May 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

12.9% regression in media.android.tough_video_cases_tbmv2 at 474544:474617

Project Member Reported by toyoshim@chromium.org, May 30 2017

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=727631

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg-u_oowsM


Bot(s) for this bug's original alert(s):

android-nexus7v2
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, May 30 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus7_perf_bisect
  Benchmark    : media.android.tough_video_cases_tbmv2
  Metric       : cpu_time_percentage_avg/video.html?src_crowd720_vp9.webm_seek

Revision             Result                    N
chromium@474543      0.958929 +- 0.242364      21      good
chromium@474617      0.968495 +- 0.094219      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.crowd720.vp9.webm.seek media.android.tough_video_cases_tbmv2

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8978177336327426368

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5245481153724416


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 5 by 42576172...@developer.gserviceaccount.com, May 30 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus7_perf_bisect
  Benchmark    : media.android.tough_video_cases_tbmv2
  Metric       : cpu_time_percentage_avg/video.html?src_crowd720_vp9.webm_seek

Revision             Result                    N
chromium@474543      0.959843 +- 0.186091      21      good
chromium@474617      0.956875 +- 0.109104      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.crowd720.vp9.webm.seek media.android.tough_video_cases_tbmv2

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8978170774231848352

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5245481153724416


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
kicked with a wider range
Project Member

Comment 8 by 42576172...@developer.gserviceaccount.com, May 31 2017

Mergedinto: 726937
Status: Duplicate (was: Untriaged)

=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : bcwhite
  Commit : 9963f7ea173756bc0b8014ed0dcd9bd48a6d3598
  Date   : Wed May 24 20:52:36 2017
  Subject: Added support for 'spare' file that can be used at startup.

Bisect Details
  Configuration: android_nexus7_perf_bisect
  Benchmark    : media.android.tough_video_cases_tbmv2
  Metric       : cpu_time_percentage_avg/video.html?src_crowd720_vp9.webm_seek
  Change       : 15.93% | 0.849384052387 -> 0.984658409215

Revision             Result                     N
chromium@474208      0.849384 +- 0.120831       6      good
chromium@474413      0.878964 +- 0.0995456      9      good
chromium@474414      0.968881 +- 0.0329344      6      bad       <--
chromium@474415      0.977683 +- 0.057468       6      bad
chromium@474417      0.941845 +- 0.0651612      6      bad
chromium@474420      0.940539 +- 0.111364       9      bad
chromium@474426      0.979787 +- 0.0337344      6      bad
chromium@474439      0.959069 +- 0.0798323      9      bad
chromium@474464      0.974203 +- 0.0169859      6      bad
chromium@474515      0.964621 +- 0.0301635      6      bad
chromium@474617      0.984658 +- 0.0344826      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.crowd720.vp9.webm.seek media.android.tough_video_cases_tbmv2

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8978090048437520912

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6407980355944448


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Sign in to add a comment