New issue
Advanced search Search tips

Issue 710772 link

Starred by 1 user
Status: WontFix
Owner: ----
Closed: Apr 2017
Cc:
simonhatch@chromium.org
hablich@chromium.org
sullivan@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression

Blocked on:
issue 713155


Sign in to add a comment

3%-302.5% regression in v8.runtimestats.browsing_mobile at 462276:462744

Project Member Reported by hablich@chromium.org, Apr 12 2017 
See the link to graphs below.

Comment 1 by hablich@chromium.org, Apr 12 2017 

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=710772

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_InopwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_LWntgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggsCKuAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_KWK_ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_JbxpwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_JCMvgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvOaKjwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJXHswoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_NiMqwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvNuX9woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvPSxvAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvN2npAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_JiE-AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvLKaowkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_JK8sAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3JnUywoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvIP0uAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvNKSsAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvNHKuQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3JnUywgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvN328QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvN328QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3M78jwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3JnUiwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvPnN_QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvKipqAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3LrW3AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvPnN_QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvLvfpQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJ-7vwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvKKNoAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvKWkvAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvKHHuAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3JqpmwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJ_trgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvKi2sQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3JnUiwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvIy3oAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvODY8AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_JTwvQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvNuX9wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvN32sQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvKvxvAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJH7oAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3Pjp1wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvKj4vgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgguS3twkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvPuSrQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvNL2qQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJ_YqgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_LX2qwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_LryuAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_NyI6AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtyNtwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_KrqsgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_NHQogkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvPuSnQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvIPF7QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvPaOogkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJWpvQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvMjB-goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_PjgrAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvPHk_wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_NivvgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_LTlowkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJX2rAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvMfdrAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvIj97QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvOOorAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvNHKhQgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvNq1kggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvMfdrAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvOXVsQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_ICctQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvOLO9QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvODYyAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJWEpAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvODYiAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvOPcvQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvOKy5AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_NLZqwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJHY-ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvOOorAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_OKe5gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvPHusAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_NLDugoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvNCmkAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvIr0pAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvIfMpwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_IjX7woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvL-b5wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJXitQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJLs6ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3KnqzgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_PS4ugoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_OjL8AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_OjL8AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_OK3vwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_NLZqwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvO_qtQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvOnimggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvPCrkQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_JSh6ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_LCPiAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3Ivm2AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvJaNrQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg3MuUowoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvMW_rQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgvMzrrAoM


Bot(s) for this bug's original alert(s):

android-webview-nexus5X
android-webview-nexus6
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Apr 13 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found, tests failed to produce values

Bisect Details
  Configuration: android_webview_arm64_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile
  Metric       : GC:duration_avg/browse_social/browse_social_twitter


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.social.twitter v8.runtimestats.browsing_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982534312565707824

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6074859181834240


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Comment 7 by hablich@chromium.org, Apr 19 2017

Labels: Needs-Feedback
Project Member

Comment 8 by 42576172...@developer.gserviceaccount.com, Apr 19 2017 


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile
  Metric       : Compile:duration_avg/browse_news/browse_news_hackernews


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.hackernews v8.runtimestats.browsing_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981895699128168464

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5238093868695552


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, Apr 19 2017 


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile
  Metric       : API:duration_avg/browse_news/browse_news_cnn


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981896672241318848

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6140433211588608


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Comment 10 by hablich@chromium.org, Apr 19 2017

Cc: sullivan@chromium.org simonhatch@chromium.org
Annie, Simon, any clue what's happening here?

Comment 12 by sullivan@chromium.org, Apr 19 2017

Blockedon: 713155

Comment 13 by sullivan@chromium.org, Apr 19 2017 

Looks like an offline device, filed a labs ticket.
Project Member

Comment 14 by 42576172...@developer.gserviceaccount.com, Apr 19 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile
  Metric       : API:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@462290      2543.28 +- 114.218      21      good
chromium@462744      2561.18 +- 138.087      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981891920652182688

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6140433211588608


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 17 by 42576172...@developer.gserviceaccount.com, Apr 22 2017 


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_webview_arm64_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile_classic
  Metric       : v8-gc-total_max/browse_social/browse_social_twitter


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.social.twitter v8.runtimestats.browsing_mobile_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981801009837601744

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5238093868695552


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 18 by 42576172...@developer.gserviceaccount.com, Apr 22 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile
  Metric       : API:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@462290      2543.28 +- 114.218      21      good
chromium@462744      2561.18 +- 138.087      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981785579998275552

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6140433211588608


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Comment 19 by hablich@chromium.org, Apr 28 2017

Status: WontFix (was: Untriaged)
Closing because this seems a bot problem ...?
Project Member

Comment 22 by 42576172...@developer.gserviceaccount.com, Apr 30 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile_classic
  Metric       : API:duration_avg/browse_social/browse_social_twitter

Revision             Result                  N
chromium@462275      130.819 +- 15.5657      21      good
chromium@462744      129.517 +- 13.0864      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.social.twitter v8.runtimestats.browsing_mobile_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981004392329303600

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5238093868695552


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 23 by 42576172...@developer.gserviceaccount.com, Apr 30 2017 


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile_classic
  Metric       : API:duration_avg/browse_social/browse_social_twitter

Revision             Result                  N
chromium@462275      129.476 +- 14.138       21      good
chromium@462744      129.557 +- 11.9175      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.social.twitter v8.runtimestats.browsing_mobile_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8980964743792745408

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6140433211588608


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
►

Sign in to add a comment