New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 629105 link

Starred by 2 users
Status: Archived
Owner:
█ petrcermak@chromium.org
Last visit > 30 days ago
Closed: Sep 2016
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression

Blocked on:
issue 638599


Sign in to add a comment

14.1%-39.6% regression in system_health.memory_desktop at 404912:405002

Project Member Reported by petrcermak@chromium.org, Jul 18 2016 
See the link to graphs below.

Comment 1 by petrcermak@chromium.org, Jul 18 2016 

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=629105

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgyoWiogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgyu3tuAkM


Bot(s) for this bug's original alert(s):

chromium-rel-win10
win-zenbook
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Jul 18 2016 


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean      Std Dev  N   Good?
chromium@404911  23846779  594014   12  good
chromium@405002  23112442  1016325  8   bad

Bisect job ran on: winx64_zen_perf_bisect
Bug ID: 629105

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_desktop
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:gpu:effective_size_avg/load_media_soundcloud
Relative Change: 4.07%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/275
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9006785442327470672


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5879636102217728

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 7 by alexclarke@chromium.org, Aug 1 2016 

Try another bisect.
Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, Aug 1 2016 

Bisect failed: Unknown
Failure reason: the build has failed.
Additional errors:
The revision range could not be expanded, or the commit positions could not be resolved into commit hashes.
Project Member

Comment 11 by 42576172...@developer.gserviceaccount.com, Aug 2 2016 

Bisect failed: Unknown
Failure reason: the build has failed.
Additional errors:
The revision range could not be expanded, or the commit positions could not be resolved into commit hashes.
Project Member

Comment 14 by 42576172...@developer.gserviceaccount.com, Aug 9 2016 


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean      Std Dev  N   Good?
chromium@404911  23595209  1057895  12  good
chromium@405002  23650506  938804   8   bad

Bisect job ran on: winx64_zen_perf_bisect
Bug ID: 629105

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_desktop
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:gpu:effective_size_avg/load_media_soundcloud
Relative Change: 0.49%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/342
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005418129739241776


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5808467680428032

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 16 by 42576172...@developer.gserviceaccount.com, Aug 11 2016 


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean      Std Dev  N  Good?
chromium@404482  19572833  1562503  5  good
chromium@405002  23855363  1275595  5  bad

Bisect job ran on: winx64_zen_perf_bisect
Bug ID: 629105

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_desktop
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:gpu:effective_size_avg/load_media_soundcloud
Relative Change: 21.88%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/376
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004714727641762976


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5832194321285120

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 18 by 42576172...@developer.gserviceaccount.com, Aug 11 2016 


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean      Std Dev  N  Good?
chromium@404482  19572833  1562503  5  good
chromium@405002  23855363  1275595  5  bad

Bisect job ran on: winx64_zen_perf_bisect
Bug ID: 629105

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_desktop
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:gpu:effective_size_avg/load_media_soundcloud
Relative Change: 21.88%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/376
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004714727641762976


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5832194321285120

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 20 by 42576172...@developer.gserviceaccount.com, Aug 12 2016 


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean      Std Dev  N   Good?
chromium@404911  23834039  1405598  12  good
chromium@405002  23429738  1011052  8   bad

Bisect job ran on: winx64_zen_perf_bisect
Bug ID: 629105

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_desktop
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:gpu:effective_size_avg/load_media_soundcloud
Relative Change: 3.60%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/379
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004714727641762976


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5832194321285120

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 22 by 42576172...@developer.gserviceaccount.com, Aug 16 2016 


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean      Std Dev  N  Good?
chromium@404482  19340372  1151997  5  good
chromium@404911  24301110  643761   5  bad

Bisect job ran on: winx64_zen_perf_bisect
Bug ID: 629105

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_desktop
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:gpu:effective_size_avg/load_media_soundcloud
Relative Change: 25.65%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/380
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004268533712506912


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5803429230804992

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 24 by 42576172...@developer.gserviceaccount.com, Aug 16 2016 


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean      Std Dev  N  Good?
chromium@404482  19340372  1151997  5  good
chromium@404911  24301110  643761   5  bad

Bisect job ran on: winx64_zen_perf_bisect
Bug ID: 629105

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_desktop
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:gpu:effective_size_avg/load_media_soundcloud
Relative Change: 25.65%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/380
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004268533712506912


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5803429230804992

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 26 by petrcermak@chromium.org, Aug 17 2016

Blockedon: 638599
Project Member

Comment 27 by 42576172...@developer.gserviceaccount.com, Aug 17 2016 


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean      Std Dev  N   Good?
chromium@404911  23957063  1137167  12  good
chromium@405002  23494898  726634   8   bad

Bisect job ran on: winx64_zen_perf_bisect
Bug ID: 629105

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests system_health.memory_desktop
Test Metric: load_media-memory:chrome:all_processes:reported_by_chrome:gpu:effective_size_avg/load_media_soundcloud
Relative Change: 2.97%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/385
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004268533712506912


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5803429230804992

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 28 by petrcermak@chromium.org, Aug 30 2016

Labels: SystemHealth-Sheriff

Comment 29 by petrcermak@chromium.org, Aug 30 2016

Labels: -Performance-Sheriff

Comment 30 by primiano@chromium.org, Sep 16 2016

Labels: Hotlist-SystemHealthBankruptcy
Status: Archived (was: Assigned)
Temporarily declaring bankruptcy on the *desktop* system health benchmark.
The number of alerts became unmanageable and the overall process needs to be improved to make it sustainable.
The alerts have been turned off and I'm archiving the outstanding regressions.
Note: this is just about desktop, the mobile system health stays up.
►

Sign in to add a comment