New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 650176 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Last visit > 30 days ago
Closed: Jan 2017
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

2.6% regression in memory.top_10_mobile at 420826:420835

Project Member Reported by hpayer@chromium.org, Sep 26 2016

Issue description

See the link to graphs below.
 

Comment 1 by hpayer@chromium.org, Sep 26 2016

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=650176

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgxaaZowkM


Bot(s) for this bug's original alert(s):

android-one
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Sep 27 2016


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision                       Mean    Std Dev  N  Good?
chromium@420825                892213  2454.18  5  good
chromium@420830                891929  8541.19  5  good
chromium@420830,v8@84145a149b  903357  3852.65  5  good
chromium@420830,v8@85575cd8ee  894867  2408.41  5  good
chromium@420831                914117  3416.0   5  bad
chromium@420832                913409  4946.35  4  bad
chromium@420833                914165  5531.49  5  bad
chromium@420835                910822  3785.8   5  bad

Bisect job ran on: android_one_perf_bisect
Bug ID: 650176

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests memory.top_10_mobile
Test Metric: memory:chrome:renderer_processes:reported_by_chrome:v8:heap:code_space:effective_size_avg/memory:chrome:renderer_processes:reported_by_chrome:v8:heap:code_space:effective_size_avg
Relative Change: 2.09%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1643
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9000471383990082320


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5226980109189120

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N  Good?
chromium@419540  1564615  3750.61  5  good
chromium@419988  1570433  5022.15  5  good
chromium@420016  1568448  3878.47  5  good
chromium@420030  1583927  7049.44  5  good
chromium@420044  1606408  4382.17  5  bad
chromium@420100  1610802  4340.21  5  bad
chromium@420212  1607441  2620.61  5  bad
chromium@420436  1605184  5935.08  5  bad
chromium@421330  1617969  1881.59  5  bad

Bisect job ran on: android_nexus5_perf_bisect
Bug ID: 650176

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests memory.top_10_mobile
Test Metric: memory:chrome:renderer_processes:reported_by_chrome:v8:heap:code_space:effective_size_avg/memory:chrome:renderer_processes:reported_by_chrome:v8:heap:code_space:effective_size_avg
Relative Change: 3.41%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/4178
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8999657868074384096


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5861328290316288

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 6 by rbyers@chromium.org, Nov 18 2016

Labels: Performance

Comment 7 by hpayer@chromium.org, Jan 19 2017

Status: Fixed (was: Assigned)
Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, Apr 12 2017


=== BISECT JOB RESULTS ===
Perf regression found but unable to narrow commit range

Build failures prevented the bisect from narrowing the range further.


Bisect Details
  Configuration: android_one_perf_bisect
  Benchmark    : memory.top_10_mobile
  Metric       : memory:chrome:renderer_processes:reported_by_chrome:v8:heap:code_space:effective_size_avg/memory:chrome:renderer_processes:reported_by_chrome:v8:heap:code_space:effective_size_avg
  Change       : 2.67% | 821138.56 -> 843037.706667

Suspected Commit Range
  36 commits in range
  https://chromium.googlesource.com/chromium/src/+log/c7e97c1604e0d4c9e42f357365ba609fb3ef92fd..5728b19d6b9f8c94c83e1736c54e9c0db136e25e


Revision                           Result                 N
chromium@420825                    821139 +- 5971.76      6        good
chromium@420830                    820860 +- 5131.4       6        good
chromium@420830,v8@dfbb3db5ef      ---                    ---      build failure
---                                ---                    ---      too many build failures to list
chromium@420830,v8@9041e3bfae      ---                    ---      build failure
chromium@420831                    842469 +- 12162.0      6        bad
chromium@420832                    843984 +- 9359.14      5        bad
chromium@420833                    843010 +- 9025.07      6        bad
chromium@420835                    843038 +- 7080.32      6        bad

Please refer to the following doc on diagnosing memory regressions:
  https://chromium.googlesource.com/chromium/src/+/master/docs/memory-infra/memory_benchmarks.md

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests memory.top_10_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982651643033689952

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5226980109189120


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Sign in to add a comment