New issue
Advanced search Search tips

Issue 733957 link

Starred by 1 user

Issue metadata

Status: Archived
Owner: ----
Closed: Dec 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

17% regression in oortonline at 479147:479271

Project Member Reported by mlippautz@google.com, Jun 16 2017

Issue description

See the link to graphs below.
 
Project Member

Comment 2 by 42576172...@developer.gserviceaccount.com, Jun 16 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_10_12_perf_bisect
  Benchmark    : oortonline
  Metric       : Total/http___oortonline.gl__run

Revision             Result                  N
chromium@479146      9319.52 +- 183.563      21      good
chromium@479271      9288.57 +- 351.365      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...oortonline.gl..run oortonline

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8976648601944186880

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4832361235087360


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 4 by 42576172...@developer.gserviceaccount.com, Jun 16 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_10_12_perf_bisect
  Benchmark    : oortonline
  Metric       : Total/http___oortonline.gl__run

Revision             Result                  N
chromium@479146      9374.76 +- 671.806      21      good
chromium@479271      9299.05 +- 189.159      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...oortonline.gl..run oortonline

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8976641956633830544

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4832361235087360


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Jun 19 2017


=== BISECT JOB RESULTS ===
Bisect was unable to run to completion

Error: INFRA_FAILURE

The bisect was able to narrow the range, you can try running with:
  good_revision: 048e61d50c55b8708794673546b546de626c8e16
  bad_revision : 6d96b8285c1d57854c6679c6d3e9dbef1e683d1b

If failures persist contact the team (see below) and report the error.


Bisect Details
  Configuration: mac_10_12_perf_bisect
  Benchmark    : oortonline
  Metric       : Total/http___oortonline.gl__run

Revision             Result                  N
chromium@479100      9345.0 +- 483.684       14      good
chromium@479150      9332.22 +- 165.395      9       good
chromium@479164      9588.33 +- 660.82       6       good
chromium@479178      9235.0 +- 312.33        14      bad
chromium@479205      9251.43 +- 291.841      14      bad
chromium@479310      9312.14 +- 660.784      14      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...oortonline.gl..run oortonline

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8976360945323531904

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5881044475052032


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 10 by 42576172...@developer.gserviceaccount.com, Jun 19 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_10_12_perf_bisect
  Benchmark    : oortonline
  Metric       : Total/http___oortonline.gl__run

Revision             Result                  N
chromium@479164      9290.0 +- 340.588       21      good
chromium@479178      9277.14 +- 198.062      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...oortonline.gl..run oortonline

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8976332195471513360

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5145816001413120


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 12 by 42576172...@developer.gserviceaccount.com, Jun 19 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_10_12_perf_bisect
  Benchmark    : oortonline
  Metric       : Total/http___oortonline.gl__run

Revision             Result                  N
chromium@479164      9293.33 +- 321.351      21      good
chromium@479178      9309.52 +- 168.805      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...oortonline.gl..run oortonline

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8976321089140837904

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5145816001413120


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 13 by 42576172...@developer.gserviceaccount.com, Jun 20 2017


=== BISECT JOB RESULTS ===
Perf regression found but unable to narrow commit range

Build failures prevented the bisect from narrowing the range further.


Bisect Details
  Configuration: mac_10_12_perf_bisect
  Benchmark    : oortonline
  Metric       : Total/http___oortonline.gl__run
  Change       : 0.87% | 9324.28571429 -> 9243.33333333

Suspected Commit Range
  15 commits in range
  https://chromium.googlesource.com/chromium/src/+log/d6ce53c7b0a9683d85f6f4276795490f4e8ddc24..048e61d50c55b8708794673546b546de626c8e16


Revision             Result                  N
chromium@479100      9324.29 +- 132.449      14       good
chromium@479149      9288.57 +- 234.033      14       good
chromium@479150      ---                     ---      build failure
---                  ---                     ---      too many build failures to list
chromium@479163      ---                     ---      build failure
chromium@479164      9274.29 +- 193.243      14       bad
chromium@479178      9253.33 +- 143.527      9        bad
chromium@479205      9274.29 +- 117.23       14       bad
chromium@479310      9243.33 +- 204.939      9        bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...oortonline.gl..run oortonline

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8976328637525220912

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5881044475052032


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 14 by sheriffbot@chromium.org, Jul 12 2017

Labels: Hotlist-Google
Project Member

Comment 17 by 42576172...@developer.gserviceaccount.com, Jul 27 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_10_12_perf_bisect
  Benchmark    : oortonline
  Metric       : Total/http___oortonline.gl__run

Revision             Result                  N
chromium@479146      9304.29 +- 189.511      21      good
chromium@479271      9298.57 +- 245.066      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...oortonline.gl..run oortonline

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8972910315603086240


For feedback, file a bug with component Speed>Bisection
Project Member

Comment 19 by 42576172...@developer.gserviceaccount.com, Jul 27 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_10_12_mini_8gb_perf_bisect
  Benchmark    : oortonline
  Metric       : Total/http___oortonline.gl__run

Revision             Result                  N
chromium@479116      9383.33 +- 243.447      21      good
chromium@479301      9419.05 +- 156.144      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...oortonline.gl..run oortonline

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8972905014690409360


For feedback, file a bug with component Speed>Bisection
Status: Archived (was: Untriaged)

Sign in to add a comment