New issue
Advanced search Search tips

Issue 657690 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 657207
Owner: ----
Closed: Oct 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

36.6% regression in service_worker.service_worker_micro_benchmark at 425664:425688

Project Member Reported by horo@chromium.org, Oct 20 2016

Issue description

See the link to graphs below.
 

Comment 1 by horo@chromium.org, Oct 20 2016

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=657690

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg7Z-6oAoM


Bot(s) for this bug's original alert(s):

chromium-rel-mac-retina

Comment 3 by horo@chromium.org, Oct 20 2016

Components: Blink>ServiceWorker
Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Oct 20 2016


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev   N   Good?
chromium@425663  3.16139  0.419789  18  good
chromium@425688  5.1275   5.57639   18  bad

Bisect job ran on: mac_retina_perf_bisect
Bug ID: 657690

Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests service_worker.service_worker_micro_benchmark
Test Metric: concurrent_1_response_99_percentile/concurrent_1_response_99_percentile
Relative Change: 3.25%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_retina_perf_bisect/builds/1758
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8998314434297271920


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5819790805958656

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Oct 20 2016


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev   N   Good?
chromium@425663  3.26056  0.465659  18  good
chromium@425688  3.20306  0.322587  18  bad

Bisect job ran on: mac_retina_perf_bisect
Bug ID: 657690

Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests service_worker.service_worker_micro_benchmark
Test Metric: concurrent_1_response_99_percentile/concurrent_1_response_99_percentile
Relative Change: 3.04%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_retina_perf_bisect/builds/1759
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8998314387787235744


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5826406565543936

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 8 by horo@chromium.org, Oct 20 2016

Mergedinto: 657207
Status: Duplicate (was: Untriaged)
Hmm, this performance result is not stable...

But I think  Issue 657207  seems to be related to this issue.
Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, Oct 20 2016


===== BISECT JOB RESULTS =====
Status: completed


===== SUSPECTED CL(s) =====
Subject : [turbofan] Funnel class constructors through TurboFan.
Author  : mstarzinger
Commit description:
  
This makes optimization of all class constructors (i.e. both base and
derived) go through TurboFan. Note some class constructors containing
Harmony language features (e.g. super constructor calls or accesses to
the new.target value) were already going through TurboFan before.

R=bmeurer@chromium.org
BUG= v8:5458 

Review-Url: https://codereview.chromium.org/2397723002
Cr-Commit-Position: refs/heads/master@{#40342}
Commit  : 3c6bbe07e8033b25e1f64d2e46aadd586f5ed32b
Date    : Mon Oct 17 08:58:25 2016


===== TESTED REVISIONS =====
Revision                       Mean   Std Dev    N  Good?
chromium@425625                2.26   0.128062   5  good
chromium@425657                2.38   0.0776209  5  good
chromium@425658                2.269  0.18454    5  good
chromium@425658,v8@87ae05c7c4  2.359  0.164294   5  good
chromium@425658,v8@3c6bbe07e8  3.294  0.0973653  5  bad    <--
chromium@425658,v8@9768ff47e7  6.428  7.66081    5  bad
chromium@425658,v8@e0b4b1b63f  3.45   0.104463   5  bad
chromium@425659                3.196  0.290676   5  bad
chromium@425660                3.313  0.633192   5  bad
chromium@425662                3.358  0.0901804  5  bad
chromium@425666                6.549  8.04809    5  bad
chromium@425675                2.961  0.326523   5  bad
chromium@425688                3.256  0.337905   5  bad

Bisect job ran on: mac_retina_perf_bisect
Bug ID: 657690

Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests service_worker.service_worker_micro_benchmark
Test Metric: concurrent_1_response_99_percentile/concurrent_1_response_99_percentile
Relative Change: 44.07%
Score: 0.0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_retina_perf_bisect/builds/1760
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8998313490879870768


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5869151153815552

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Sign in to add a comment