New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 713613 link

Starred by 1 user
Status: Duplicate
Merged: issue 712217
Owner:
█ hpayer@chromium.org
Last visit > 30 days ago
Closed: Apr 2017
Cc:
█ hpayer@chromium.org
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

17.3%-2602.3% regression in memory.top_10_mobile_stress at 464710:464733

Project Member Reported by hpayer@google.com, Apr 20 2017 
See the link to graphs below.

Comment 1 by hpayer@google.com, Apr 20 2017 

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=713613

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwqyszggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgguWYhwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggsW20AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_NqbkQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggqPVyAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgws6P9wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtHL5QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_LnM1AsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwp6ougoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggu6D2QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggq-30QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggu-oqAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_N-v9gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtWbjgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwsTauQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwuiYuwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggrn6lggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwrjXuAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggrvC9gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggvHv6AsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggs3apQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggqy-swkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtaaiggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggqaDogkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggs_87QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggsb14QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggquDvAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwq6tqQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggrXXlAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggu7SvwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgguXm9wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggq7r5goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtjsqQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtih-QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwpyzngkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwrHk9gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggrP3twoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtOWuQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwpqhtAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_Lnl4wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_L3szwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgguOp_AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwprwqQsM


Bot(s) for this bug's original alert(s):

android-nexus5
android-nexus6
android-nexus7v2
android-one
Project Member

Comment 5 by 42576172...@developer.gserviceaccount.com, Apr 20 2017 


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_one_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile
  Metric       : v8-gc-incremental-start_sum/browse_news/browse_news_nytimes


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.nytimes v8.runtimestats.browsing_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981805217915867264

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5896627245547520


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Apr 20 2017

Mergedinto: 712217
Status: Duplicate (was: Assigned)

=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : nednguyen
  Commit : 9a1915060877f610870645a720d8d6eb177d0a0e
  Date   : Fri Apr 14 11:50:07 2017
  Subject: Revert of Convert android to use X509CertificateBytes instead of X509CertificateOpenSSL. (patchset #9 id:160001 of https://codereview.chromium.org/2786173003/ )

Bisect Details
  Configuration: android_one_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile
  Metric       : v8-gc-scavenger_avg/browse_news/browse_news_nytimes
  Change       : 26.25% | 7.13139555556 -> 9.00368371188

Revision             Result                   N
chromium@464709      7.1314 +- 0.648293       6      good
chromium@464713      7.19777 +- 0.680216      6      good
chromium@464714      7.42507 +- 0.954207      6      good
chromium@464715      8.68076 +- 0.476623      6      bad       <--
chromium@464717      9.00368 +- 1.08904       6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.nytimes v8.runtimestats.browsing_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981805115716668512

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5601639496417280


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 8 by 42576172...@developer.gserviceaccount.com, Apr 20 2017 


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : nednguyen
  Commit : 9a1915060877f610870645a720d8d6eb177d0a0e
  Date   : Fri Apr 14 11:50:07 2017
  Subject: Revert of Convert android to use X509CertificateBytes instead of X509CertificateOpenSSL. (patchset #9 id:160001 of https://codereview.chromium.org/2786173003/ )

Bisect Details
  Configuration: android_one_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile
  Metric       : v8-gc-incremental-start_sum/browse_news/browse_news_nytimes
  Change       : 1747.91% | 2.077 -> 38.381

Revision             Result                  N
chromium@464709      2.077 +- 1.62355        6      good
chromium@464713      3.71983 +- 4.44515      6      good
chromium@464714      2.3315 +- 2.54828       6      good
chromium@464715      38.1478 +- 5.88952      6      bad       <--
chromium@464717      38.381 +- 6.66342       6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.nytimes v8.runtimestats.browsing_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981800935469917360

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5896627245547520


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, Apr 20 2017 


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : nednguyen
  Commit : 9a1915060877f610870645a720d8d6eb177d0a0e
  Date   : Fri Apr 14 11:50:07 2017
  Subject: Revert of Convert android to use X509CertificateBytes instead of X509CertificateOpenSSL. (patchset #9 id:160001 of https://codereview.chromium.org/2786173003/ )

Bisect Details
  Configuration: android_nexus5_perf_bisect
  Benchmark    : memory.top_10_mobile_stress
  Metric       : memory:chrome:renderer_processes:reported_by_chrome:v8:heap:effective_size_avg/memory:chrome:renderer_processes:reported_by_chrome:v8:heap:effective_size_avg
  Change       : 102.42% | 3304541.33333 -> 6688934.26667

Revision             Result                  N
chromium@464713      3304541 +- 17124.1      6      good
chromium@464714      3297658 +- 10699.1      6      good
chromium@464715      6656022 +- 137331       6      bad       <--
chromium@464716      6652663 +- 148356       6      bad
chromium@464719      6688934 +- 123058       6      bad

Please refer to the following doc on diagnosing memory regressions:
  https://chromium.googlesource.com/chromium/src/+/master/docs/memory-infra/memory_benchmarks.md

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests memory.top_10_mobile_stress

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981805104999550512

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6424515032121344


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
►

Sign in to add a comment