New issue
Advanced search Search tips

Issue 734004 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Jun 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

3.2%-4.3% regression in speedometer at 479148:479375

Project Member Reported by tebbi@chromium.org, Jun 16 2017

Issue description

See the link to graphs below.
 

Comment 1 by tebbi@chromium.org, Jun 16 2017

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=734004

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgttCZggoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtpzgiggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtrmR5AkM


Bot(s) for this bug's original alert(s):

chromium-rel-mac11-air
chromium-rel-win7-gpu-ati
chromium-rel-win8-dual
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Jun 16 2017

Cc: gambard@chromium.org
Owner: gambard@chromium.org

=== Auto-CCing suspected CL author gambard@chromium.org ===

Hi gambard@chromium.org, the bisect results pointed to your CL, please take a look at the
results.


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : gambard
  Commit : 58d4f1565451328da41bb0dc5392d67bd4919b88
  Date   : Wed Jun 14 08:13:14 2017
  Subject: Add EG test for SCContentSuggestions

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : speedometer
  Metric       : EmberJS-TodoMVC/EmberJS-TodoMVC
  Change       : 1.91% | 910.930392857 -> 928.355142857

Revision             Result                  N
chromium@479147      910.93 +- 55.8286       14      good
chromium@479261      911.111 +- 20.3854      9       good
chromium@479318      904.317 +- 21.0061      9       good
chromium@479322      900.457 +- 14.0886      6       good
chromium@479323      943.499 +- 43.3618      6       bad       <--
chromium@479324      929.748 +- 31.9113      6       bad
chromium@479326      923.336 +- 56.7443      14      bad
chromium@479333      938.525 +- 25.139       9       bad
chromium@479347      930.97 +- 79.7607       9       bad
chromium@479375      928.355 +- 59.8745      14      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests speedometer

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8976637660999732816

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5295126110273536


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Owner: ----
My CL only added tests, I don't think it introduced the regression.

Comment 5 by tebbi@chromium.org, Jun 16 2017

Status: WontFix (was: Untriaged)
Too flaky to bisect.

Sign in to add a comment