New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 628253 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 628268
Owner:
Last visit > 30 days ago
Closed: Jul 2016
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

1.3%-351.4% regression in system_health.memory_mobile at 405140:405221

Project Member Reported by petrcermak@chromium.org, Jul 14 2016

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=628253

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgioT5oAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8pfR4ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8t_R-QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8rPz7goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgir68uwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgisCshggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8vPJuAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgip776AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgit73swkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8oeilgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiorJ9ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgipDYrgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8o358AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgisnr_AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgisDa5wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgisKtoQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiqnnrwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8vXo_QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8rPz7gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8onSrAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgitPkqgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8vOisAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8rfhtAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiqLU-AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgip6J4AsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgisSGtQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgipCWoQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8qH07wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgis2YugoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgitDKrQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgio3TsgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgioSjsQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgsr_p-QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8tHoiAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiunVuQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8q_P6QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgirq1tQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgirqrrAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgir7NrgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgip6JkAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8oed_wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8rec-AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgisCV7wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgsoOGjgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgitrZ7woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8v_18AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgitrD_goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8q7mhwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiqyNqAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8uHt4gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgitCTsgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8uHt4gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgipP_8wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8tey9wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8pya7AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgirrfvQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgitD3qwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgirP6qQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgir7NrgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8ovg7QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgio2PqwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiqL57QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8oed_wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8pvk8AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgirPhuAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8ovg7QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgisCV7wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgirXzpgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgit7e7AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgioyx5QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgium6sQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8vfppwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgirOIoQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgipn2ogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgir6bvwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8ozImggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgsrv7lwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgsoOGzgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8vbvhgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgitCFowsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8ui7qwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8pya7AsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiqLAqQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgitOXvwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgivSTvwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiriq8AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgium68QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgisTI-QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8rPQ8woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgis3mtgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiqLAqQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg8ofdgAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgioSjsQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgioLg9QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgisCsxggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiqKKlQgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgipOouQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiqnO-gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiqmk8gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgio7SpAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgiva_qAkM


Bot(s) for this bug's original alert(s):

android-galaxy-s5
android-nexus5
android-nexus5X
android-nexus6
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Jul 14 2016

Mergedinto: 628268
Status: Duplicate (was: Assigned)

===== BISECT JOB RESULTS =====
Status: completed


===== SUSPECTED CL(s) =====
Subject : Add benchmark that imitates news reading.
Author  : ulan
Commit description:
  
Each story in the benchmark does the following:
1. Load the main page.
2. Open and scroll the first news item.
3. Go back to the main page and scroll it.
4. Open and scroll the second news item.
5. Go back to the main page and scroll it.
6. etc.

This workflow is interesting because it is close to real world
and generates a lot of garbage by creating and discarding pages.

A couple of websites crash with OOM on svelte device, so by
tracking and optimizing for this benchmark we can improve
user experience on low-memory devices.

*** NOTE TO SHERRIF ***
Regressions are expected in system_health.memory_mobile and
system_health.memory_desktop for the following stories:
- load:news:cnn
- load:social:facebook
- load:news:qq
- load:news:reddit
- load:social:twitter

If there are failing tests in form of benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*
please do not revert this CL but instead disabling failing
test by adding them into the _DISABLE_TESTS list in
tools/perf/benchmarks/system_health_smoke_test.py

BUG=589726
CQ_INCLUDE_TRYBOTS=tryserver.chromium.perf:android_s5_perf_cq;tryserver.chromium.perf:mac_retina_perf_cq

Review-Url: https://codereview.chromium.org/2118293002
Cr-Commit-Position: refs/heads/master@{#405212}
Commit  : 5b1847df818e5be4592e9a6ac4832350bb663023
Date    : Wed Jul 13 17:39:28 2016


===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N  Good?
chromium@405208  1727693  8394.3   5  good
chromium@405211  1726054  4670.16  5  good
chromium@405212  7834829  14306.7  5  bad    <--
chromium@405213  7831552  19211.9  5  bad
chromium@405214  7834010  12150.7  5  bad
chromium@405220  7836467  4486.94  5  bad

Bisect job ran on: android_nexus5_perf_bisect
Bug ID: 628253

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_social-memory:chrome:all_processes:reported_by_os:system_memory:ashmem:private_dirty_size_avg/load_social_twitter
Relative Change: 353.58%
Score: 99.9

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/3834
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9007147017362422128


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5845880276516864

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Labels: SystemHealth-Sheriff
Labels: -Performance-Sheriff

Sign in to add a comment