New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 727306 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner:
Email to this user bounced
Closed: Jun 2017
Cc:
EstimatedDays: ----
NextAction: 2017-06-12
OS: Android
Pri: 2
Type: Bug-Regression



Sign in to add a comment

14.5%-52.8% regression in power.typical_10_mobile at 475195:475243

Project Member Reported by toyoshim@chromium.org, May 29 2017

Issue description

See the link to graphs below.
 
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, May 29 2017


=== BISECT JOB RESULTS ===
NO Perf regression found, tests failed to produce values

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : system_health.common_mobile
  Metric       : story:power_avg/browse_media/browse_media_imgur


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.imgur system_health.common_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8978257868077424256

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5665491349143552


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 5 by 42576172...@developer.gserviceaccount.com, May 29 2017


=== BISECT JOB RESULTS ===
NO Perf regression found, tests failed to produce values

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : system_health.common_mobile
  Metric       : story:power_avg/browse_media/browse_media_imgur


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.imgur system_health.common_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8978246276145245776

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5665491349143552


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, May 30 2017


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : power.typical_10_mobile
  Metric       : energy_consumption_mwh/energy_consumption_mwh


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests power.typical_10_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8978176770542235456

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5904499996098560


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, May 30 2017


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : power.typical_10_mobile
  Metric       : energy_consumption_mwh/energy_consumption_mwh


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests power.typical_10_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8978174546894818864

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5904499996098560


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Owner: charliea@chromium.org
Status: Assigned (was: Untriaged)
Hey Charlie, what do you think's going on here?
NextAction: 2017-06-12
Kicking off another bisect because the logs from the previous one seem to have expired (?)

=== BISECT JOB RESULTS ===
NO Perf regression found, tests failed to produce values

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : system_health.common_mobile
  Metric       : story:power_avg/browse_shopping/browse_shopping_amazon


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.shopping.amazon system_health.common_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977228992887346688

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5136902534987776


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 15 by 42576172...@developer.gserviceaccount.com, Jun 10 2017

Cc: ke...@intel.com
Owner: ke...@intel.com

=== Auto-CCing suspected CL author ke.he@intel.com ===

Hi ke.he@intel.com, the bisect results pointed to your CL, please take a look at the
results.


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : Ke He
  Commit : dd2fa336d116912de565aa11f9b916341be3d579
  Date   : Sat May 27 03:04:28 2017
  Subject: Fix the wrong wake lock type in devtools

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : system_health.common_mobile
  Metric       : story:power_avg/browse_shopping/browse_shopping_amazon
  Change       : 18.78% | 1.45152963508 -> 1.72409329094

Revision             Result                    N
chromium@475226      1.45153 +- 0.0588734      6      good
chromium@475227      1.45914 +- 0.0792815      6      good
chromium@475228      1.73426 +- 0.0673007      6      bad       <--
chromium@475229      1.71698 +- 0.0366425      6      bad
chromium@475231      1.73779 +- 0.0703654      6      bad
chromium@475235      1.72221 +- 0.0490337      6      bad
chromium@475243      1.72409 +- 0.050547       6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.shopping.amazon system_health.common_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977219509041824240

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5136902534987776


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Comment 16 by ke...@intel.com, Jun 12 2017

Cc: charliea@chromium.org
Hi, Charlie, Sorry I know very little about the run_benchmark test here.
There is an  issue 726290  in which I made a very similar fix. Is it duplicated to this one?
The NextAction date has arrived: 2017-06-12
Status: WontFix (was: Assigned)
Thanks for the link to the other bug Ke He! It looks like your "regression" here is actually just fixing the bug introduced in your other CL, as seen on this performance graphs. You can see a graph of the breakage and its revert here: https://chromeperf.appspot.com/group_report?sid=5fe3c7e484ced238e9521e4ea92eaeb75b6f2664cb6254a754ed4e19c21c8668.

Going to go ahead and close this as WontFix.

Sign in to add a comment