New issue
Advanced search Search tips

Issue 664103 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner: ----
Closed: Nov 2016
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression

Blocked on:
issue 664497

Blocking:
issue 616932



Sign in to add a comment

23.3%-93.2% regression in page_cycler_v2_site_isolation.basic_oopif at 430594:430665

Project Member Reported by perezju@chromium.org, Nov 10 2016

Issue description

(Also testing new bisect script)
 
Blocking: 616932
Project Member

Comment 5 by 42576172...@developer.gserviceaccount.com, Nov 11 2016


===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@430593  890.066  182.384  27  good
chromium@430665  892.319  100.012  27  bad

Bisect job ran on: winx64_zen_perf_bisect
Bug ID: 664103

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...www.google.com.hk..q..E9.82.84.E6.8F.90.E4.BE.9B.fp.c44d333e710cb480 page_cycler_v2.intl_ja_zh
Test Metric: timeToFirstContentfulPaint_avg/pcv1-cold/http___www.google.com.hk__q_%E9%82%84%E6%8F%90%E4%BE%9B_fp_c44d333e710cb480
Relative Change: None

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/592
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8996335380089683552


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5832131098443776

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Blockedon: 664497
Project Member

Comment 8 by 42576172...@developer.gserviceaccount.com, Nov 11 2016


===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@430593  897.69   241.581  27  good
chromium@430665  894.948  200.083  27  bad

Bisect job ran on: winx64_zen_perf_bisect
Bug ID: 664103

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...www.google.com.hk..q..E9.82.84.E6.8F.90.E4.BE.9B.fp.c44d333e710cb480 page_cycler_v2.intl_ja_zh
Test Metric: timeToFirstMeaningfulPaint_avg/pcv1-cold/http___www.google.com.hk__q_%E9%82%84%E6%8F%90%E4%BE%9B_fp_c44d333e710cb480
Relative Change: None

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/595
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8996285288552277456


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6472945453498368

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 10 by 42576172...@developer.gserviceaccount.com, Nov 12 2016


===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence.
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@430593  1049.33  409.484  27  good
chromium@430665  1042.11  363.234  27  bad

Bisect job ran on: winx64_zen_perf_bisect
Bug ID: 664103

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...www.google.com.hk..q..E9.82.84.E6.8F.90.E4.BE.9B.fp.c44d333e710cb480 page_cycler_v2.intl_ja_zh
Test Metric: timeToFirstContentfulPaint_avg/pcv1-cold/http___www.google.com.hk__q_%E9%82%84%E6%8F%90%E4%BE%9B_fp_c44d333e710cb480
Relative Change: None

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/599
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8996212148855302208


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6368935975321600

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Status: Fixed (was: Untriaged)
lgtm with the exception of "Relative change: None", for which I filed  bug 664743 . I'll mark this one fixed.

Sign in to add a comment