New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 708553 link

Starred by 2 users

Issue metadata

Status: WontFix
Owner:
Email to this user bounced
Closed: Aug 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

1%-14.4% regression in system_health.memory_mobile at 461404:461499

Project Member Reported by pmeenan@chromium.org, Apr 5 2017

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=708553

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3Mfm9goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3K7U-AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3PXuuAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvNiFrQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3Ljf4wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3ImVqQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvKqeuAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3NfL6wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3N7LuwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvK7qugkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3PfapAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvK706woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3JzY7gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3Mv5qgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvICLqAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvOy64QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvOy6oQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvM74uAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvOy6oQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3MujuwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3NXe7AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3N_kqgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvK6ltgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3OeNpgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3PHp-wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3KnqtgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvKrU8AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3PHp-wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3PHp-woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJqkrwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3Ne18gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3PyjrAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3O6N9ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3LzNgQgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3Nz3qwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3O6R5wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgnMfr8gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3JXt8QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvImrqwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvICVsQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJrZsQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3IDF6wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvICwtgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvICwtgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvI6L8AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3KmzoAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvLjNtgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3LWmpgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3NqMrwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3K2LswoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3K3VogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJjtoQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3K7AqQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3LzougoM


Bot(s) for this bug's original alert(s):

android-nexus5
android-nexus6
android-nexus7v2
android-webview-nexus5X
Cc: jwo...@igalia.com
Owner: jwo...@igalia.com

=== Auto-CCing suspected CL author jwolfe@igalia.com ===

Hi jwolfe@igalia.com, the bisect results pointed to your CL, please take a look at the
results.


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : Josh Wolfe
  Commit : 2474b73472bbe5313ed043b348e93b96167423dd
  Date   : Mon Apr 03 08:40:26 2017
  Subject: Convert String.prototype.normalize from JS to CPP builtin

Bisect Details
  Configuration: android_webview_arm64_aosp_perf_bisect
  Benchmark    : system_health.memory_mobile
  Metric       : memory:webview:all_processes:reported_by_chrome:v8:effective_size_avg/blank_about/blank_about_blank
  Change       : 14.24% | 2745544.0 -> 3136408.0

Revision                           Result                  N
chromium@461410                    2745544 +- 0.0          6      good
chromium@461412                    2745544 +- 0.0          6      good
chromium@461412,v8@8af394d6d3      2745544 +- 0.0          6      good
chromium@461412,v8@2474b73472      3136584 +- 329.266      6      bad       <--
chromium@461412,v8@5833e77744      3136555 +- 203.227      6      bad
chromium@461413                    3136437 +- 321.331      6      bad
chromium@461416                    3136496 +- 248.902      6      bad
chromium@461421                    3136555 +- 321.331      6      bad
chromium@461431                    3136408 +- 329.266      6      bad

Please refer to the following doc on diagnosing memory regressions:
  https://chromium.googlesource.com/chromium/src/+/master/docs/memory-infra/memory_benchmarks.md

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=blank.about.blank system_health.memory_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8983144851082653120

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5809280818610176


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Comment 4 by adamk@chromium.org, Apr 12 2017

Cc: adamk@chromium.org
The blamed patch might have caused a tiny increase in memory usage due to the addition of four string constants. But beyond that, prior patches which removed JS builtins code have led to bumpy, observable changes on certain benchmarks which went away based on other unrelated-looking changes. We have a broader project goal of eliminating all of this code, and the blamed patch does this move in a straightforward way.

Recently, there was a significant regression in this metric many times greater than the regression blamed on this patch. I think the right action to take here would be to keep an eye on this dashboard and see if the regression blamed on this patch is still there when the bigger, unrelated regression is resolved.

Comment 6 by adamk@chromium.org, Apr 12 2017

I also don't trust the bisect, fwiw (marked it as "wrong" from the link above).
Status: Assigned (was: Untriaged)
Explictly assigning. A CL you landed tripped one of the speed metrics we measure in the lab. If this is the first time this has happened to one of your CLs, or if it's been a while, please read: https://chromium.googlesource.com/chromium/src/+/master/docs/speed/addressing_performance_regressions.md

We're looking for one of the following:
1. Justification via explanation
2. Plan to revert or fix
3. Angry rage throwing of equipment at my head

Just be aware that I'm trained in trumpet playing and First Aid and am not afraid to use it.

Note: This was a bulk edit message and not very personal.
Status: WontFix (was: Assigned)
You can find such a justification above. I don't think we need a revert or fix.
Labels: Performance-Tradeoff

Sign in to add a comment