New issue
Advanced search Search tips

Issue 718804 link

Starred by 1 user

Issue metadata

Status: WontFix
Merged: issue 718803
Owner:
Closed: May 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

18.7%-22.4% regression in v8.runtimestats.browsing_mobile_classic at 469135:469224

Project Member Reported by verwa...@chromium.org, May 5 2017

Issue description

See the link to graphs below.
 

=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_webview_arm64_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile_classic
  Metric       : Optimize:duration_avg/browse_media/browse_media_imgur


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.imgur v8.runtimestats.browsing_mobile_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8980437109345744800

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6114497464369152


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_webview_arm64_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile_classic
  Metric       : Optimize:duration_avg/browse_media/browse_media_imgur


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.imgur v8.runtimestats.browsing_mobile_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8980299809199853776

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6114497464369152


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Owner: tebbi@chromium.org
Status: Assigned (was: Untriaged)
Project Member

Comment 8 by 42576172...@developer.gserviceaccount.com, May 19 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile_classic
  Metric       : JavaScript:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@468609      18008.8 +- 5159.8       21      good
chromium@469185      17515.8 +- 18298.7      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_mobile_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8979162715123844656

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5343819169529856


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 10 by 42576172...@developer.gserviceaccount.com, May 20 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile_classic
  Metric       : JavaScript:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@468609      18516.7 +- 6056.01      21      good
chromium@469185      18659.7 +- 4951.88      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_mobile_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8979148468439077312

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5343819169529856


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Comment 11 by tebbi@chromium.org, May 24 2017

Mergedinto: 718803
Status: Duplicate (was: Assigned)

=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile_classic
  Metric       : Total:duration_avg/browse_news/browse_news_toi


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.toi v8.runtimestats.browsing_mobile_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977541437215662928

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5806286643396608


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile_classic
  Metric       : Total:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@468609      83785.2 +- 6412.81      21      good
chromium@469185      84360.0 +- 10465.2      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_mobile_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977541457305689984

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6723181898891264


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile_classic
  Metric       : Total:duration_avg/browse_news/browse_news_toi


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.toi v8.runtimestats.browsing_mobile_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977525275798085616

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5806286643396608


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile_classic
  Metric       : Total:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@468609      83785.2 +- 6412.81      21      good
chromium@469185      84360.0 +- 10465.2      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_mobile_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977525272650308960

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6723181898891264


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
The bisects cannot reproduce the measured regression. So it's probably a change in the bots or benchmarks.
Status: WontFix (was: Duplicate)

Sign in to add a comment