New issue
Advanced search Search tips

Issue 700559 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 699705
Owner: ----
Closed: Mar 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

1.3%-875% regression in media.android.tough_video_cases at 455708:455885

Project Member Reported by liberato@google.com, Mar 10 2017

Issue description

See the link to graphs below.
 

Comment 1 by liberato@google.com, Mar 10 2017

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=700559

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglKfijQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglOea5gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Ka66wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1PC-8QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KfZ7goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KH_3QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglKvQoAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1OiXrwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1LWcpQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Pq3sgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtISwvwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Key5goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1MLHrggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KOpjQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtLjI6AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1MLisgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglO-SsAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NDMyQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1N-S5QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Mj5vwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglKfijQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1OiXzwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglN_JwAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NbWzgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KOpjQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Jr79QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglN_JwAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KOpjQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KH_3QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5I_BwwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1OiXzwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Key5ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglO-SsAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglK-f3woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1M7_-ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NDMyQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1JK0lggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NSc2gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglJGa8wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1OqM6wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglOvCwgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglP2VhwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtPjEswkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1ImQvAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1OqzrwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1L-w8goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1ICKqQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglIfS0wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Or-5wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglMHOzQgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1PL1xQgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Nyj6AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NGS9QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1JXonAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1LTE8QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglJHzhgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KOp9QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1LTE8QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1LTE8QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1OTRwQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NCBlQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1OyFlQgM


Bot(s) for this bug's original alert(s):

android-nexus5
android-nexus5X
android-nexus7v2
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Mar 11 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : media.android.tough_video_cases
  Metric       : vm_shared_dirty_delta/crowd1080_vp9.webm_browser

Revision             Result                   N
chromium@455776      -96.8571 +- 776.802      21      good
chromium@455844      -142.476 +- 1342.1       21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8985467808649859376

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6695854460633088


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Frank, I notice these graphs follow a pattern of restoring the metric to a previous high value after all temporarily dropping down for a few hundred revisions. I'll bisect the initial dip just for curiosity, but I suspect its either a transient issue (improvement?) or a commit that landed/reverted.

Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Mar 14 2017

Mergedinto: 699705
Status: Duplicate (was: Untriaged)

=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : pdr
  Commit : a20ad732333dc9db2b545886acd16a11abdc5842
  Date   : Tue Mar 07 17:11:15 2017
  Subject: Remove indirection: setup scrollbar scroll layers in the scrollbar constructor

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : media.android.tough_video_cases
  Metric       : vm_shared_dirty_delta/tulip2.ogv_browser
  Change       : 127.27% | -22.0 -> -50.0

Revision             Result                   N
chromium@455068      -22.0 +- 20.199          6      good
chromium@455091      -3.33333 +- 30.6812      6      good
chromium@455102      8.0 +- 13.8564           6      good
chromium@455104      8.0 +- 13.8564           6      good
chromium@455105      -34.6667 +- 14.6059      6      bad       <--
chromium@455108      -26.0 +- 14.6969         6      bad
chromium@455113      -50.0 +- 14.6969         6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8985214568514745744

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5341580405243904


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Sign in to add a comment