New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 670223 link

Starred by 2 users
Status: WontFix
Owner: ----
Closed: Jul 2017
Cc:
perezju@chromium.org
█ benhenry@chromium.org
primiano@chromium.org
█ hjd@chromium.org
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

1.0MiB regression in java_heap on browse:social:twitter while disabled during 431567:434535

Project Member Reported by perezju@chromium.org, Dec 1 2016 
regressions in browse:social:twitter

got disabled at r431570 and re-enabled at r434507

Comment 3 by perezju@chromium.org, Dec 1 2016

Cc: benhenry@chromium.org hjd@chromium.org
Bisect is probably not going to work for the same reasons as go/catabug/3053
Project Member

Comment 4 by 42576172...@developer.gserviceaccount.com, Dec 1 2016 


===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence.
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean      Std Dev  N   Good?
chromium@431566  11981521  5151430  27  good
chromium@434529  12068333  5611246  27  bad

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 670223

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.social.twitter system_health.memory_mobile
Test Metric: memory:chrome:all_processes:reported_by_os:system_memory:java_heap:proportional_resident_size_avg/browse_social/browse_social_twitter
Relative Change: None

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/930
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8994484898572707856


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5863845447335936

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 5 by perezju@chromium.org, Dec 5 2016

Cc: primiano@chromium.org
Hector, maybe a "dumb bisect" could work here? Since you can keep the version of catapult pinned at ToT.

If so, I would suggest trying to bisect on:
https://chromeperf.appspot.com/report?sid=008c9c47b29335267da2a8398ae444cfd3a03bf7d154fda366e46613a5a97afd&start_rev=430186&end_rev=436241

Comment 6 by perezju@chromium.org, Dec 5 2016

Summary: 1.0MiB regression in java_heap on browse:social:twitter while disabled during 431567:434535 (was: 4.7%-97.2% regression in system_health.memory_mobile at 429449:434535)

Comment 7 by hjd@chromium.org, Dec 7 2016 

Okay, I kicked off a dumb bisect :)

Comment 10 by hjd@google.com, Dec 13 2016 

'dumb bisect' is a local script which runs the benchmark for all the revisions in the range (in a smart order but it doesn't binary search like bisect does). We tried it but results where drowned out by some kind of local leak since the script doesn't reset phone between revisions. At that point we gave up for a while and moved on to higher priority things (and I was supposed to comment on the bug which I forgot to do, sorry...)

When perezju and I discussed this we thought that bisect won't work here because the test was disabled in the range (so bisect will skip it). See go/catabug/3053. If it works that would be awesome though! Otherwise if I find time I can try refining the script or we can try getting the change mentioned in go/catabug/3053 in.
Project Member

Comment 11 by 42576172...@developer.gserviceaccount.com, Dec 14 2016 


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean      Std Dev  N   Good?
chromium@431566  21612629  354982   12  good
chromium@432956  N/A       N/A      0   unknown
chromium@432957  N/A       N/A      0   unknown
chromium@432958  N/A       N/A      0   unknown
chromium@432959  N/A       N/A      0   unknown
chromium@432960  N/A       N/A      0   unknown
chromium@432961  N/A       N/A      0   unknown
chromium@432962  N/A       N/A      0   unknown
chromium@432963  N/A       N/A      0   unknown
chromium@432964  N/A       N/A      0   unknown
chromium@432965  N/A       N/A      0   unknown
chromium@432966  N/A       N/A      0   unknown
chromium@432967  N/A       N/A      0   unknown
chromium@432968  N/A       N/A      0   unknown
chromium@432969  N/A       N/A      0   unknown
chromium@432970  N/A       N/A      0   unknown
chromium@432971  N/A       N/A      0   unknown
chromium@432972  N/A       N/A      0   unknown
chromium@432973  N/A       N/A      0   unknown
chromium@432974  N/A       N/A      0   unknown
chromium@432975  N/A       N/A      0   unknown
chromium@432976  N/A       N/A      0   unknown
chromium@432977  N/A       N/A      0   unknown
chromium@432978  N/A       N/A      0   unknown
chromium@432979  N/A       N/A      0   unknown
chromium@432980  N/A       N/A      0   unknown
chromium@432981  N/A       N/A      0   unknown
chromium@432982  N/A       N/A      0   unknown
chromium@432983  N/A       N/A      0   unknown
chromium@432984  N/A       N/A      0   unknown
chromium@432985  N/A       N/A      0   unknown
chromium@432986  N/A       N/A      0   unknown
chromium@432987  N/A       N/A      0   unknown
chromium@432988  N/A       N/A      0   unknown
chromium@432989  N/A       N/A      0   unknown
chromium@432990  N/A       N/A      0   unknown
chromium@432991  N/A       N/A      0   unknown
chromium@432992  N/A       N/A      0   unknown
chromium@432993  N/A       N/A      0   unknown
chromium@432994  N/A       N/A      0   unknown
chromium@432995  N/A       N/A      0   unknown
chromium@432996  N/A       N/A      0   unknown
chromium@432997  N/A       N/A      0   unknown
chromium@432998  N/A       N/A      0   unknown
chromium@432999  N/A       N/A      0   unknown
chromium@433000  N/A       N/A      0   unknown
chromium@433001  N/A       N/A      0   unknown
chromium@433002  N/A       N/A      0   unknown
chromium@433003  N/A       N/A      0   unknown
chromium@433004  N/A       N/A      0   unknown
chromium@433005  N/A       N/A      0   unknown
chromium@433006  N/A       N/A      0   unknown
chromium@433007  N/A       N/A      0   unknown
chromium@433008  N/A       N/A      0   unknown
chromium@433009  N/A       N/A      0   unknown
chromium@433010  N/A       N/A      0   unknown
chromium@433011  N/A       N/A      0   unknown
chromium@433012  N/A       N/A      0   unknown
chromium@433013  N/A       N/A      0   unknown
chromium@433014  N/A       N/A      0   unknown
chromium@433015  N/A       N/A      0   unknown
chromium@433016  N/A       N/A      0   unknown
chromium@433017  N/A       N/A      0   unknown
chromium@433018  N/A       N/A      0   unknown
chromium@433019  N/A       N/A      0   unknown
chromium@433020  N/A       N/A      0   unknown
chromium@433021  N/A       N/A      0   unknown
chromium@433022  N/A       N/A      0   unknown
chromium@433023  N/A       N/A      0   unknown
chromium@433024  N/A       N/A      0   unknown
chromium@433025  N/A       N/A      0   unknown
chromium@433026  N/A       N/A      0   unknown
chromium@433027  N/A       N/A      0   unknown
chromium@433028  N/A       N/A      0   unknown
chromium@433029  N/A       N/A      0   unknown
chromium@433030  N/A       N/A      0   unknown
chromium@433031  N/A       N/A      0   unknown
chromium@433032  N/A       N/A      0   unknown
chromium@433033  N/A       N/A      0   unknown
chromium@433034  N/A       N/A      0   unknown
chromium@433037  N/A       N/A      0   unknown
chromium@433038  N/A       N/A      0   unknown
chromium@433039  N/A       N/A      0   unknown
chromium@433040  N/A       N/A      0   unknown
chromium@433041  N/A       N/A      0   unknown
chromium@433042  N/A       N/A      0   unknown
chromium@433043  N/A       N/A      0   unknown
chromium@433044  N/A       N/A      0   unknown
chromium@433045  N/A       N/A      0   unknown
chromium@433046  N/A       N/A      0   unknown
chromium@433047  N/A       N/A      0   unknown
chromium@433048  N/A       N/A      0   unknown
chromium@433049  N/A       N/A      0   unknown
chromium@433050  N/A       N/A      0   unknown
chromium@433051  N/A       N/A      0   unknown
chromium@433052  N/A       N/A      0   unknown
chromium@433053  N/A       N/A      0   unknown
chromium@433054  N/A       N/A      0   unknown
chromium@433055  N/A       N/A      0   unknown
chromium@433056  N/A       N/A      0   unknown
chromium@433057  N/A       N/A      0   unknown
chromium@433058  N/A       N/A      0   unknown
chromium@433059  N/A       N/A      0   unknown
chromium@433060  N/A       N/A      0   unknown
chromium@433061  N/A       N/A      0   unknown
chromium@433062  N/A       N/A      0   unknown
chromium@433063  N/A       N/A      0   unknown
chromium@433064  N/A       N/A      0   unknown
chromium@433065  N/A       N/A      0   unknown
chromium@433066  N/A       N/A      0   unknown
chromium@433067  N/A       N/A      0   unknown
chromium@433068  N/A       N/A      0   unknown
chromium@433069  N/A       N/A      0   unknown
chromium@433070  N/A       N/A      0   unknown
chromium@433071  N/A       N/A      0   unknown
chromium@433072  N/A       N/A      0   unknown
chromium@433073  N/A       N/A      0   unknown
chromium@433074  N/A       N/A      0   unknown
chromium@433075  N/A       N/A      0   unknown
chromium@433076  N/A       N/A      0   unknown
chromium@433077  N/A       N/A      0   unknown
chromium@433078  N/A       N/A      0   unknown
chromium@433079  N/A       N/A      0   unknown
chromium@433080  N/A       N/A      0   unknown
chromium@433081  N/A       N/A      0   unknown
chromium@433082  N/A       N/A      0   unknown
chromium@433083  N/A       N/A      0   unknown
chromium@433084  N/A       N/A      0   unknown
chromium@433085  N/A       N/A      0   unknown
chromium@433086  N/A       N/A      0   unknown
chromium@433087  N/A       N/A      0   unknown
chromium@433088  N/A       N/A      0   unknown
chromium@433089  N/A       N/A      0   unknown
chromium@433090  N/A       N/A      0   unknown
chromium@433091  N/A       N/A      0   unknown
chromium@433092  N/A       N/A      0   unknown
chromium@433093  N/A       N/A      0   unknown
chromium@433094  N/A       N/A      0   unknown
chromium@433095  N/A       N/A      0   unknown
chromium@433096  N/A       N/A      0   unknown
chromium@433097  N/A       N/A      0   unknown
chromium@433098  N/A       N/A      0   unknown
chromium@433099  N/A       N/A      0   unknown
chromium@433100  N/A       N/A      0   unknown
chromium@433101  N/A       N/A      0   unknown
chromium@433102  N/A       N/A      0   unknown
chromium@433103  N/A       N/A      0   unknown
chromium@433104  N/A       N/A      0   unknown
chromium@433105  N/A       N/A      0   unknown
chromium@433106  N/A       N/A      0   unknown
chromium@433107  N/A       N/A      0   unknown
chromium@433108  N/A       N/A      0   unknown
chromium@433109  N/A       N/A      0   unknown
chromium@433110  N/A       N/A      0   unknown
chromium@433111  N/A       N/A      0   unknown
chromium@433112  N/A       N/A      0   unknown
chromium@433113  N/A       N/A      0   unknown
chromium@433114  N/A       N/A      0   unknown
chromium@433115  N/A       N/A      0   unknown
chromium@433116  N/A       N/A      0   unknown
chromium@433117  N/A       N/A      0   unknown
chromium@433118  N/A       N/A      0   unknown
chromium@433119  N/A       N/A      0   unknown
chromium@433120  N/A       N/A      0   unknown
chromium@433121  N/A       N/A      0   unknown
chromium@433122  N/A       N/A      0   unknown
chromium@433123  N/A       N/A      0   unknown
chromium@433124  N/A       N/A      0   unknown
chromium@433125  N/A       N/A      0   unknown
chromium@433126  N/A       N/A      0   unknown
chromium@433127  N/A       N/A      0   unknown
chromium@433128  N/A       N/A      0   unknown
chromium@433129  N/A       N/A      0   unknown
chromium@433130  N/A       N/A      0   unknown
chromium@433131  N/A       N/A      0   unknown
chromium@433132  N/A       N/A      0   unknown
chromium@433133  N/A       N/A      0   unknown
chromium@433134  N/A       N/A      0   unknown
chromium@433135  N/A       N/A      0   unknown
chromium@433136  N/A       N/A      0   unknown
chromium@433137  N/A       N/A      0   unknown
chromium@433138  N/A       N/A      0   unknown
chromium@433139  N/A       N/A      0   unknown
chromium@433140  N/A       N/A      0   unknown
chromium@433141  N/A       N/A      0   unknown
chromium@433142  N/A       N/A      0   unknown
chromium@433143  N/A       N/A      0   unknown
chromium@433144  N/A       N/A      0   unknown
chromium@433145  N/A       N/A      0   unknown
chromium@434535  22779319  2076074  14  bad

Bisect job ran on: android_nexus6_perf_bisect
Bug ID: 670223

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.social.twitter system_health.memory_mobile
Test Metric: memory:chrome:all_processes:reported_by_os:system_memory:java_heap:proportional_resident_size_avg/browse_social/browse_social_twitter
Relative Change: 6.82%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus6_perf_bisect/builds/2829
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8993362026386193072


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5777701120507904

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 13 by benhenry@chromium.org, Jul 27 2017

Status: WontFix (was: Untriaged)
This alert was found before M-60 branched. Closing as WontFix as this is believed to either be invalid or non-reproducible.
►

Sign in to add a comment