Issue 726804 link

Starred by 1 user

Issue metadata

Status:	WontFix
Owner:	----
Closed:	Jun 2017
Cc:	tguilbert@chromium.org
EstimatedDays:	----
NextAction:	----
OS:	----
Pri:	2
Type:	Bug-Regression
M-60

18.6%-526.7% regression in media.android.tough_video_cases at 470280:470346

Project Member Reported by tguilbert@chromium.org, May 26 2017

Issue description

See the link to graphs below.

Comment 1 by tguilbert@chromium.org, May 26 2017

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=726804

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDguvLZngsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg-rSNrAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDguqun_QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDguvfx6wgM


Bot(s) for this bug's original alert(s):

android-nexus5X

Project Member

Comment 2 by 42576172...@developer.gserviceaccount.com, May 26 2017

Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8978507349785149008

Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, May 27 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : media.android.tough_video_cases
  Metric       : vm_proportional_set_size_delta/tulip2.m4a_browser

Revision             Result                  N
chromium@470279      2245.29 +- 3063.53      21      good
chromium@470346      2303.9 +- 2610.21       21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8978507349785149008

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6158784180781056


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Project Member

Comment 4 by 42576172...@developer.gserviceaccount.com, May 27 2017

Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8978465219751117264

Project Member

Comment 5 by 42576172...@developer.gserviceaccount.com, May 27 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : media.android.tough_video_cases
  Metric       : vm_proportional_set_size_delta/tulip2.m4a_browser

Revision             Result                  N
chromium@470279      2188.0 +- 2891.92       21      good
chromium@470346      2621.57 +- 2411.98      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8978465219751117264

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6158784180781056


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Jun 2 2017

Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8977858188413242512

Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Jun 2 2017

Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8977858175184133584

Project Member

Comment 8 by 42576172...@developer.gserviceaccount.com, Jun 3 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : media.android.tough_video_cases
  Metric       : vm_proportional_set_size_delta/tulip2.m4a_browser

Revision             Result                 N
chromium@470279      2238.0 +- 3058.04      21      good
chromium@470346      2351.9 +- 2646.43      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977858188413242512

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5589763182034944


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, Jun 3 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : media.android.tough_video_cases
  Metric       : vm_private_dirty_delta/tulip2.m4a_browser

Revision             Result                  N
chromium@470279      198.286 +- 3140.69      21      good
chromium@470346      604.571 +- 2504.71      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977858175184133584

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4926643853852672


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Project Member

Comment 10 by 42576172...@developer.gserviceaccount.com, Jun 3 2017

Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8977838590570452848

Project Member

Comment 11 by 42576172...@developer.gserviceaccount.com, Jun 3 2017

Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8977838588660053232

Project Member

Comment 12 by 42576172...@developer.gserviceaccount.com, Jun 3 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : media.android.tough_video_cases
  Metric       : vm_private_dirty_delta/tulip2.m4a_browser

Revision             Result                 N
chromium@470279      193.524 +- 3135.9      21      good
chromium@470346      394.286 +- 2660.3      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977838590570452848

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4926643853852672


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Project Member

Comment 13 by 42576172...@developer.gserviceaccount.com, Jun 3 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : media.android.tough_video_cases
  Metric       : vm_proportional_set_size_delta/tulip2.m4a_browser

Revision             Result                  N
chromium@470279      2177.67 +- 2912.96      21      good
chromium@470346      2291.57 +- 2652.21      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977838588660053232

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5589763182034944


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Comment 14 by tguilbert@chromium.org, Jun 13 2017

Status: WontFix (was: Untriaged)

Values have returned to normal, and no regression was found from the bisect.

►

Issue 726804 link

Issue metadata

18.6%-526.7% regression in media.android.tough_video_cases at 470280:470346

Issue description

Comment 1 by tguilbert@chromium.org, May 26 2017

Comment 1 Deleted

Comment 2 by 42576172...@developer.gserviceaccount.com, May 26 2017

Comment 2 Deleted

Comment 3 by 42576172...@developer.gserviceaccount.com, May 27 2017

Comment 3 Deleted

Comment 4 by 42576172...@developer.gserviceaccount.com, May 27 2017

Comment 4 Deleted

Comment 5 by 42576172...@developer.gserviceaccount.com, May 27 2017

Comment 5 Deleted

Comment 6 by 42576172...@developer.gserviceaccount.com, Jun 2 2017

Comment 6 Deleted

Comment 7 by 42576172...@developer.gserviceaccount.com, Jun 2 2017

Comment 7 Deleted

Comment 8 by 42576172...@developer.gserviceaccount.com, Jun 3 2017

Comment 8 Deleted

Comment 9 by 42576172...@developer.gserviceaccount.com, Jun 3 2017

Comment 9 Deleted

Comment 10 by 42576172...@developer.gserviceaccount.com, Jun 3 2017

Comment 10 Deleted

Comment 11 by 42576172...@developer.gserviceaccount.com, Jun 3 2017

Comment 11 Deleted

Comment 12 by 42576172...@developer.gserviceaccount.com, Jun 3 2017

Comment 12 Deleted

Comment 13 by 42576172...@developer.gserviceaccount.com, Jun 3 2017

Comment 13 Deleted

Comment 14 by tguilbert@chromium.org, Jun 13 2017

Comment 14 Deleted

Sign in to add a comment