New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 635520 link

Starred by 0 users

Issue metadata

Status: WontFix
Owner:
Closed: May 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

No data received for system_health.memory_mobile from android-nexus5X since 405937

Project Member Reported by petrcermak@chromium.org, Aug 8 2016

Issue description

See the link to graphs below.
 

===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean  Std Dev  N  Good?
chromium@405937  0.0   0.0      5  good

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 635520

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_search-memory:chrome:all_processes:reported_by_chrome:gpumemorybuffer:effective_size_avg/load_search_taobao
Relative Change: None
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/464
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004890960713429056


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5848515398336512

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean  Std Dev  N  Good?
chromium@405937  0.0   0.0      5  good

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 635520

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_search-memory:chrome:all_processes:reported_by_chrome:gpumemorybuffer:effective_size_avg/load_search_taobao
Relative Change: None
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/464
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004890960713429056


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5848515398336512

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/474
Failure reason: the build has failed.
Additional errors:
The metric was not found in the test output.
Either of the initial "good" or "bad" revisions failed to be tested or built.

Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/474
Failure reason: the build has failed.
Additional errors:
The metric was not found in the test output.
Either of the initial "good" or "bad" revisions failed to be tested or built.

We know that the r405937 is good (from #6) and r406089 is bad (from #8) now.
Project Member

Comment 13 by 42576172...@developer.gserviceaccount.com, Aug 11 2016


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean  Std Dev  N  Good?
chromium@405987  0.0   0.0      5  good

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 635520

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_search-memory:chrome:all_processes:reported_by_chrome:gpumemorybuffer:effective_size_avg/load_search_taobao
Relative Change: None
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/502
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004628639022113328


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5820569589645312

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Assuming no flakes, we can infer from #13 that the value disappeared between r405987 (good) and r406038 (bad).
Project Member

Comment 17 by 42576172...@developer.gserviceaccount.com, Aug 11 2016


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean  Std Dev  N  Good?
chromium@405987  0.0   0.0      5  good

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 635520

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_search-memory:chrome:all_processes:reported_by_chrome:gpumemorybuffer:effective_size_avg/load_search_taobao
Relative Change: None
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/502
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004628639022113328


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5820569589645312

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 18 by 42576172...@developer.gserviceaccount.com, Aug 11 2016

Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/503
Failure reason: the build has failed.
Additional errors:
The metric was not found in the test output.
Either of the initial "good" or "bad" revisions failed to be tested or built.

Project Member

Comment 20 by 42576172...@developer.gserviceaccount.com, Aug 11 2016

Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/503
Failure reason: the build has failed.
Additional errors:
The metric was not found in the test output.
Either of the initial "good" or "bad" revisions failed to be tested or built.

We can infer that the value disappeared between r405987 (good, #13) and r406004 (bad, #20): http://test-results.appspot.com/revision_range?start=405988&end=406004
Project Member

Comment 23 by 42576172...@developer.gserviceaccount.com, Aug 12 2016


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean  Std Dev  N   Good?
chromium@405992  0.0   0.0      12  good
chromium@405998  0.0   0.0      8   bad

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 635520

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_search-memory:chrome:all_processes:reported_by_chrome:gpumemorybuffer:effective_size_avg/load_search_taobao
Relative Change: 0.00%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/510
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004525999379824768


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5796827413086208

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Almost there: r405998 (good, #23) and r406004 (bad, #20).
Project Member

Comment 26 by 42576172...@developer.gserviceaccount.com, Aug 15 2016


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean  Std Dev  N   Good?
chromium@406000  0.0   0.0      12  good
chromium@406002  0.0   0.0      8   bad

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 635520

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_search-memory:chrome:all_processes:reported_by_chrome:gpumemorybuffer:effective_size_avg/load_search_taobao
Relative Change: 0.00%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/512
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004272676475181392


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5830772200570880

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
One more bisect to go: r406002 (good, #26) and r406004 (bad, #20).
Project Member

Comment 29 by 42576172...@developer.gserviceaccount.com, Aug 15 2016


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean  Std Dev  N  Good?
chromium@406003  0.0   0.0      5  good

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 635520

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_search-memory:chrome:all_processes:reported_by_chrome:gpumemorybuffer:effective_size_avg/load_search_taobao
Relative Change: None
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/513
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004255684649852864


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5328188817801216

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 31 by 42576172...@developer.gserviceaccount.com, Aug 15 2016


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean  Std Dev  N  Good?
chromium@406003  0.0   0.0      5  good

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 635520

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_mobile
Test Metric: load_search-memory:chrome:all_processes:reported_by_chrome:gpumemorybuffer:effective_size_avg/load_search_taobao
Relative Change: None
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/513
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004255684649852864


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5328188817801216

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Cc: aelias@chromium.org chrishtr@chromium.org picksi@chromium.org
Owner: vmi...@chromium.org
vmiura: It appears that your patch (r402702) relanded by picksi@ (r406004) resulted in data stoppage of the memory:chrome:all_processes:reported_by_chrome:gpumemorybuffer:effective_size_avg value (which is calculated from values reported from https://cs.chromium.org/chromium/src/content/browser/gpu/browser_gpu_memory_buffer_manager.cc?l=333. Can you please confirm whether this is correct behavior, or a bug?
Sorry for missing this.  It is expected - we don't use GPU Memory Buffers on Android when using GPU Raster, which my change enabled.

This test no longer has data.  Can we WontFix this?
Status: WontFix (was: Assigned)

Sign in to add a comment