New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 653000 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Last visit > 30 days ago
Closed: Feb 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

22.6%-49.7% regression in memory.long_running_idle_gmail_tbmv2 at 406346:420666

Project Member Reported by hpayer@chromium.org, Oct 5 2016

Issue description

See the link to graphs below.
 

===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@420258  12.7508  3.0218   18  good
chromium@420286  11.9154  2.0181   18  bad

Bisect job ran on: win_perf_bisect
Bug ID: 653000

Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests memory.long_running_idle_gmail_tbmv2
Test Metric: v8-gc-scavenger_max/v8-gc-scavenger_max
Relative Change: 6.51%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/win_perf_bisect/builds/6972
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8999657429035051024


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6440759710973952

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 5 by 42576172...@developer.gserviceaccount.com, Oct 12 2016


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean     Std Dev   N   Good?
chromium@406345  3.79678  0.201914  18  good
chromium@408135  4.11789  0.754176  18  good
chromium@409033  3.94508  0.462343  12  good
chromium@409481  4.70875  3.09229   12  good
chromium@409703  3.81539  0.170385  18  good
chromium@409814  4.01411  0.547612  18  good
chromium@409925  4.45928  0.957695  18  bad
chromium@413506  4.32933  0.993429  12  bad
chromium@420666  4.02925  0.135473  12  bad

Bisect job ran on: win_perf_bisect
Bug ID: 653000

Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests memory.long_running_idle_gmail_tbmv2
Test Metric: v8-gc-incremental-finalize_max/v8-gc-incremental-finalize_max
Relative Change: 5.82%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/win_perf_bisect/builds/6998
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8999099965623998464


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5294969525370880

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Oct 26 2016


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@406300  11.0446  2.46731  18  good
chromium@420700  12.3956  1.86991  18  bad

Bisect job ran on: win_perf_bisect
Bug ID: 653000

Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests memory.long_running_idle_gmail_tbmv2
Test Metric: v8-gc-scavenger_max/v8-gc-scavenger_max
Relative Change: 8.87%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/win_perf_bisect/builds/7024
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8997727160345604768


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5217729135509504

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 8 by hpayer@chromium.org, Feb 24 2017

Status: Fixed (was: Assigned)
Graph recovered.
Labels: Performance-Memory

Sign in to add a comment