New issue
Advanced search Search tips

Issue 630202 link

Starred by 2 users

Issue metadata

Status: WontFix
Owner:
Closed: Jul 2016
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

1.1%-380% regression in system_health.memory_mobile at 406534:406601

Project Member Reported by petrcermak@chromium.org, Jul 21 2016

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=630202

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6uzwigsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6qWkqAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6uTi7AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmubP-QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmsSjuQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmualsQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmoGU-AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6q2_pwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6v-5pgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6rjR_QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgqsjP2AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6oDzjwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg2sittAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmtbUuwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmpbxvQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmvnCrQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmt-zvQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmrvooAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6v_DtwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmtKy-QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6rvsqwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmsH1tgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmqrqpAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6v_yqgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmujw_AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6s2UoQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmuqCqgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmurmuwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6saP_woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6sbg8wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmsGrrwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmpyDuwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6qPjwAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmpyXpgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmuD4uQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmuuQpgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6qPjoAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgqvWAhgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmoXgugoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgqsO_hQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmsGcqwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6v3CowsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmtbKpgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmqrTvQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmtaetwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmt-apAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6oPgtgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmv2SvgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6oKm5wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6q7TiwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6p6FjAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmqb4vAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmt-vogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6uS2wwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmurxpgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmq-ZqQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6oPFsQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6uONjAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmtbjvwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmvvkvQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6o2x1gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmv2ErwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg6v3W8goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmvjelQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmoqBowsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmqGZuQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgmrbosAoM


Bot(s) for this bug's original alert(s):

android-nexus5
android-nexus5X
android-nexus6
android-nexus9
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Jul 21 2016


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@406564  28672.0  7584.32  8   good
chromium@406565  31278.5  4939.96  11  bad

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 630202

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_news-memory:chrome:all_processes:reported_by_chrome:v8:allocated_by_malloc:effective_size_avg/load_news_washingtonpost
Relative Change: 0.00%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/351
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9006532007814559696


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5080428185124864

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Jul 22 2016

Cc: u...@chromium.org
Owner: u...@chromium.org

=== Auto-CCing suspected CL author ulan@chromium.org ===

Hi ulan@chromium.org, the bisect results pointed to your CL below as possibly
causing a regression. Please have a look at this info and see whether
your CL be related.


===== BISECT JOB RESULTS =====
Status: completed


===== SUSPECTED CL(s) =====
Subject : [system health] Add flipboard to system health stories.
Author  : ulan
Commit description:
  
Flipboard on mobile exercises interesting workload,
where news items are rendered using canvas.

BUG=589726

Review-Url: https://codereview.chromium.org/2162873002
Cr-Commit-Position: refs/heads/master@{#406550}
Commit  : fd43bee2311ab250b3b6181ccd8be45092234eca
Date    : Wed Jul 20 14:30:46 2016


===== TESTED REVISIONS =====
Revision         Mean    Std Dev  N  Good?
chromium@406533  290380  0.0      5  good
chromium@406549  290380  0.0      5  good
chromium@406550  868054  0.0      5  bad    <--
chromium@406551  868054  0.0      5  bad
chromium@406553  868054  0.0      5  bad
chromium@406557  868054  0.0      5  bad
chromium@406565  868054  0.0      5  bad

Bisect job ran on: android_nexus5_perf_bisect
Bug ID: 630202

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:web_cache:effective_size_avg/load_media_flickr
Relative Change: 198.94%
Score: 99.9

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/3854
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9006500982818535520


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5339183422373888

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Status: WontFix (was: Assigned)
This is not a real regression. It's due to a change in the SH story set.
Labels: SystemHealth-Sheriff
Labels: -Performance-Sheriff

Sign in to add a comment