New issue
Advanced search Search tips

Issue 653110 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner:
Closed: Aug 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

8.4%-15% regression in tab_switching.five_blank_pages at 421572:421643

Project Member Reported by majidvp@google.com, Oct 5 2016

Issue description

Maybe related to  issue 651547 .
 
Cc: nedngu...@google.com
Owner: nedngu...@google.com

=== Auto-CCing suspected CL author nednguyen@google.com ===

Hi nednguyen@google.com, the bisect results pointed to your CL below as possibly
causing a regression. Please have a look at this info and see whether
your CL be related.


===== BISECT JOB RESULTS =====
Status: completed


===== SUSPECTED CL(s) =====
Subject : [Telemetry] Add API for updating ts_proxy_server's traffic settings
Author  : nednguyen
Commit description:
  
BUG=catapult:#2584

Review-Url: https://codereview.chromium.org/2346093002
Commit  : deb46ea2ee48a9c8cd4acd57bd9e33d03f2f6d1b
Date    : Wed Sep 28 17:22:38 2016


===== TESTED REVISIONS =====
Revision                             Mean   Std Dev  N  Good?
chromium@421592                      818.0  12.1037  5  good
chromium@421597                      844.8  23.6474  5  good
chromium@421600                      822.6  7.63544  5  good
chromium@421601                      826.0  7.87401  5  good
chromium@421601,catapult@d5a6d996a3  815.0  5.70088  5  good
chromium@421601,catapult@deb46ea2ee  936.2  8.78635  5  bad    <--
chromium@421602                      931.4  6.26897  5  bad
chromium@421611                      936.0  10.6771  5  bad
chromium@421629                      935.4  7.4364   5  bad

Bisect job ran on: mac_retina_perf_bisect
Bug ID: 653110

Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests startup.warm.blank_page
Test Metric: foreground_tab_request_start/foreground_tab_request_start
Relative Change: 14.35%
Score: 99.9

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_retina_perf_bisect/builds/1722
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8999630897531883648


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5783330342043648

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 4 by sheriffbot@chromium.org, Oct 7 2016

Labels: Hotlist-Google
Cc: -nedngu...@google.com
Owner: robert...@chromium.org
My CL is a no-op change. I believe this is a bad bisect
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Oct 26 2016

Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_retina_perf_bisect/builds/1766
Failure reason: the build has failed.
Additional errors:
The metric was not found in the test output.
Either of the initial "good" or "bad" revisions failed to be tested or built.

Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, Nov 17 2016

Cc: nedngu...@google.com
Owner: nedngu...@google.com

=== Auto-CCing suspected CL author nednguyen@google.com ===

Hi nednguyen@google.com, the bisect results pointed to your CL below as possibly
causing a regression. Please have a look at this info and see whether
your CL be related.


===== BISECT JOB RESULTS =====
Status: completed


===== SUSPECTED CL(s) =====
Subject : [Telemetry] Add API for updating ts_proxy_server's traffic settings
Author  : nednguyen
Commit description:
  
BUG=catapult:#2584

Review-Url: https://codereview.chromium.org/2346093002
Commit  : deb46ea2ee48a9c8cd4acd57bd9e33d03f2f6d1b
Date    : Wed Sep 28 17:22:38 2016


===== TESTED REVISIONS =====
Revision                             Mean     Std Dev  N   Good?
chromium@421563                      2936.85  1196.24  27  good
chromium@421583                      2862.67  546.733  12  good
chromium@421593                      2938.42  761.608  12  good
chromium@421598                      2900.67  709.092  18  good
chromium@421600                      2870.92  383.769  12  good
chromium@421601                      2851.58  410.184  12  good
chromium@421601,catapult@d5a6d996a3  2845.88  255.282  8   good
chromium@421601,catapult@deb46ea2ee  2941.28  138.512  18  bad    <--
chromium@421602                      3078.56  1056.61  18  bad

Bisect job ran on: mac_10_10_perf_bisect
Bug ID: 653110

Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests startup.cold.blank_page
Test Metric: foreground_tab_load_complete/foreground_tab_load_complete
Relative Change: 4.83%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_10_10_perf_bisect/builds/2481
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8995785901756904688


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5802150532218880

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Status: Assigned (was: Untriaged)
Project Member

Comment 12 by 42576172...@developer.gserviceaccount.com, Apr 11 2017


=== BISECT JOB RESULTS ===
NO Perf regression found, tests failed to produce values

Bisect Details
  Configuration: mac_retina_perf_bisect
  Benchmark    : startup.warm.blank_page
  Metric       : foreground_tab_request_start/foreground_tab_request_start


To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests startup.warm.blank_page

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982636311865148416

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5247011148791808


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Status: WontFix (was: Assigned)
This benchmark has been removed.

Sign in to add a comment