New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 633228 link

Starred by 2 users

Issue metadata

Status: Duplicate
Owner:
Last visit > 30 days ago
Closed: Aug 2016
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

3.2%-9.8% regression in system_health.memory_mobile at 407919:408831

Project Member Reported by petrcermak@chromium.org, Aug 1 2016

Issue description

See the link to graphs below.
 

===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean    Std Dev  N  Good?
chromium@407918  392776  15129.1  8  good
chromium@408831  412976  12858.0  8  bad

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 633228

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: browse_social-memory:chrome:all_processes:reported_by_chrome:sqlite:effective_size_avg/browse_social_facebook
Relative Change: 2.47%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/409
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005519108080164176


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5888900875157504

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean    Std Dev  N  Good?
chromium@407918  412312  0.0      5  good
chromium@408147  426506  1588.5   5  bad
chromium@408375  427216  0.0      5  bad
chromium@408831  427453  2118.0   5  bad

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 633228

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:sqlite:effective_size_avg/load_media_youtube
Relative Change: 3.67%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/445
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005163410104310992


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5882378933764096

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean    Std Dev  N  Good?
chromium@407918  412312  0.0      5  good
chromium@408147  426506  1588.5   5  bad
chromium@408375  427216  0.0      5  bad
chromium@408831  427453  2118.0   5  bad

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 633228

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:sqlite:effective_size_avg/load_media_youtube
Relative Change: 3.67%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/445
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005163410104310992


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5882378933764096

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Mergedinto: 633185
Status: Duplicate (was: Assigned)

===== BISECT JOB RESULTS =====
Status: completed


===== SUSPECTED CL(s) =====
Subject : predictors: Remove the HTTP restriction for speculative prefetch.
Author  : lizeb
Commit description:
  
The prefetcher skips the HTTPS main pages and subresources, which is
unfortunate as more and more pages and resources are served over HTTPS.

Example from loading the verge with this patch, (from
prefetch_predictor_tool.py) on Android:

https://cdn0.vox-cdn.com/stylesheets/verge2_all.v7ffc13f1b68c7dbd.css
https://cdn0.vox-cdn.com/javascripts/libraries.vc262b07aa2474684.js
https://cdn0.vox-cdn.com/javascripts/lib/advertisement.v6fdc11c.js
https://optimize-stats.voxmedia.com/loader.min.js?key=efd28c71b5699c36
https://cdn0.vox-cdn.com/javascripts/verge2_head.v43436e3cdcad9833.js
http://ad-cdn.technoratimedia.com/smartwrapper/81065/1027/sw.min.js
https://www.googletagservices.com/tag/js/gpt.js
https://cdn0.vox-cdn.com/javascripts/verge2_body.v9f33e9e87ec93cd8.js

Without:

http://ad-cdn.technoratimedia.com/smartwrapper/81065/1027/sw.min.js
http://partner.googleadservices.com/gpt/pubads_impl_92.js
http://cdn.yldbt.com/js/yieldbot.intent.js
http://ads.rubiconproject.com/header/7470.js
http://sbnationbidder-d.openx.net/w/1.0/jstag?nc=172968584-theverge1
http://cdn.krxd.net/ctjs/controltag.js.726d287890a4d2c520d4a7a450e210ea
http://www.google-analytics.com/analytics.js
http://pagead2.googlesyndication.com/pagead/osd.js

BUG=631966

Review-Url: https://codereview.chromium.org/2186803004
Cr-Commit-Position: refs/heads/master@{#408139}
Commit  : c9c483d3058976b76c1c5b4deb3047db140d89cf
Date    : Wed Jul 27 15:57:17 2016


===== TESTED REVISIONS =====
Revision         Mean    Std Dev  N  Good?
chromium@407918  412312  0.0      5  good
chromium@408033  412312  0.0      5  good
chromium@408090  412312  0.0      5  good
chromium@408119  412312  0.0      5  good
chromium@408133  412312  0.0      5  good
chromium@408137  412312  0.0      5  good
chromium@408138  412312  0.0      5  good
chromium@408139  427216  0.0      5  bad    <--
chromium@408140  427216  0.0      5  bad
chromium@408147  427216  0.0      5  bad
chromium@408375  425085  1945.51  5  bad
chromium@408831  424611  2118.0   5  bad

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 633228

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:sqlite:effective_size_avg/load_media_youtube
Relative Change: 2.98%
Score: 99.9

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/453
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005163410104310992


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5882378933764096

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Labels: SystemHealth-Sheriff
Labels: -Performance-Sheriff

Sign in to add a comment