New issue
Advanced search Search tips

Issue 629206 link

Starred by 2 users

Issue metadata

Status: Duplicate
Merged: issue 628212
Owner:
Closed: Aug 2016
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

10.2%-18.6% regression in blink_perf.shadow_dom at 405125:405214

Project Member Reported by m...@chromium.org, Jul 18 2016

Issue description

Suspecting:

commit	bd9726939278a4ce06a29875a89b5dba9f01d2ca	
author	tkent <tkent@chromium.org>	Wed Jul 13 13:11:32 2016
committer	Commit bot <commit-bot@chromium.org>	Wed Jul 13 13:13:41 2016
Simplify protocol between SELECT elements and popups.
 
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Jul 19 2016


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev   N   Good?
chromium@405134  211.931  0.739935  18  good
chromium@405135  212.454  0.916258  18  bad

Bisect job ran on: winx64intel_perf_bisect
Bug ID: 629206

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests blink_perf.shadow_dom
Test Metric: ChangingSelectWithoutShadow/ChangingSelectWithoutShadow
Relative Change: 0.24%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64intel_perf_bisect/builds/1028
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9006765795033417728


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5819614202691584

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 4 by tkent@chromium.org, Jul 19 2016

Owner: m...@chromium.org
My CL can't affect these tests.

Comment 5 by m...@chromium.org, Jul 20 2016

Owner: majidvp@chromium.org
Assigning to current perf sheriff for further triage...
Trying another bisect.
Mergedinto: 628212
Status: Duplicate (was: Assigned)

===== BISECT JOB RESULTS =====
Status: completed


===== SUSPECTED CL(s) =====
Subject : Disable Full-WPO for the x64 official build (non-PGO).
Author  : sebmarchand
Commit description:
  
Disable Full-WPO for the x64 official builds (this doesn't
affect the PGO builds).

This should help me to get an official
"non-PGO & non-WPO" build that I can compare against an official PGO
build.

Also I'm not sure if it's worth keeping WPO turned on for the official
builds at the moment ? We don't ship these builds (we ship the PGO ones)
and so this only slowdown the builders that build an official x64 build
for testing purposes (especially considering that they need to link all the unittests with Full-WPO)

BUG= 490934 , 617982

Review-Url: https://codereview.chromium.org/2142603002
Cr-Commit-Position: refs/heads/master@{#405164}
Commit  : 0d74d7f71c93bfc3b32653de7958ff84d173937d
Date    : Wed Jul 13 15:42:28 2016


===== TESTED REVISIONS =====
Revision         Mean     Std Dev   N  Good?
chromium@405000  225.837  0.640608  5  good
chromium@405150  222.302  2.17799   5  good
chromium@405161  222.256  0.419191  5  good
chromium@405163  222.291  0.524084  5  good
chromium@405164  260.442  0.704322  5  bad    <--
chromium@405166  268.702  0.986756  5  bad
chromium@405171  278.531  1.34957   5  bad
chromium@405190  262.927  0.9004    5  bad
chromium@405223  265.319  2.69953   5  bad
chromium@405300  248.996  0.365796  5  bad

Bisect job ran on: winx64_10_perf_bisect
Bug ID: 629206

Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests blink_perf.shadow_dom
Test Metric: ChangingSelectWithoutShadow/ChangingSelectWithoutShadow
Relative Change: 10.26%
Score: 99.9

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_10_perf_bisect/builds/629
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005516800970318752


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5803762543755264

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Sign in to add a comment