New issue
Advanced search Search tips

Issue 646860 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Sep 2016
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

1.1%-1.4% regression in memory.top_10_mobile_stress at 417986:418039

Project Member Reported by kouhei@chromium.org, Sep 14 2016

Issue description

See the link to graphs below.
 
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Sep 15 2016


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N  Good?
chromium@417988  1153945  2097.17  8  good
chromium@418014  1156096  4194.33  8  good
chromium@418016  1163673  3950.01  5  bad
chromium@418018  1162035  3792.16  8  bad
chromium@418021  1162035  3792.16  8  bad
chromium@418027  1161856  3662.59  8  bad
chromium@418039  1162240  3959.08  8  bad

Bisect job ran on: android_nexus5_perf_bisect
Bug ID: 646860

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests memory.top_10_mobile_stress
Test Metric: background-memory:chrome:all_processes:reported_by_os:system_memory:ashmem:proportional_resident_size_avg/after_http_search_yahoo_com_search__ylt_p_google
Relative Change: 0.55%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/4124
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9001536420705108784


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5329945750929408

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Status: Fixed (was: Assigned)
Recovered.
Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Apr 11 2017


=== BISECT JOB RESULTS ===
Perf regression found but unable to narrow commit range

Build failures prevented the bisect from narrowing the range further.


Bisect Details
  Configuration: android_nexus5_perf_bisect
  Benchmark    : memory.top_10_mobile_stress
  Metric       : background-memory:chrome:all_processes:reported_by_os:system_memory:ashmem:proportional_resident_size_avg/after_http_search_yahoo_com_search__ylt_p_google

Suspected Commit Range
  1 commits in range
  https://chromium.googlesource.com/chromium/src/+log/a74d3cbc572fa1c85cc2c0434a9f8e2f9cba0cd9..b63103ad596cb2deaf5151dd81de45de688dedeb


Revision             Result                  N
chromium@417988      1153945 +- 2097.17      8      good
chromium@418014      1156096 +- 4194.33      8      good
chromium@418016      1163673 +- 3950.01      5      bad
chromium@418018      1162035 +- 3792.16      8      bad
chromium@418021      1162035 +- 3792.16      8      bad
chromium@418027      1161856 +- 3662.59      8      bad
chromium@418039      1162240 +- 3959.08      8      bad

Please refer to the following doc on diagnosing memory regressions:
  https://chromium.googlesource.com/chromium/src/+/master/docs/memory-infra/memory_benchmarks.md

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests memory.top_10_mobile_stress

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982619920938694336

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5329945750929408


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Sign in to add a comment