New issue
Advanced search Search tips

Issue 700820 link

Starred by 2 users

Issue metadata

Status: Duplicate
Merged: issue 700364
Owner: ----
Closed: Mar 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression

Blocking:
issue 698746


Participants' hotlists:
I-TF-Launch


Sign in to add a comment

8.1%-41.1% regression (Execution speed) in v8.runtimestats.browsing_desktop at 455495:455817

Project Member Reported by hablich@chromium.org, Mar 13 2017

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=700820

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NzuiAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglJGaiwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KXtjggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1MqsjwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglKvQkAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1MOslwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NyjmAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglLvutggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NuHwAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglPyHywgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NDa5AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtITV-AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1JblkwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglKLKmgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtLzboQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtJqSogkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglM-ypAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Mm7uQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KOpzQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1MWQ2QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglIW72gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglOfQ2gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1N_p3QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1ITP3gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Pj46AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtK6e9QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KCugAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglIekggoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1OTRoQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtLzboQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1I26qAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtKCerQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1L64rQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglNKrsQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglPnTxQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KzY2goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglMPq3QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglIGN8AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtOyv9goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtITV-AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1L25hwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Je9pwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1L6ivAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NDvvAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NfMvgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglLu3wAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglLLnwgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglI_r0QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtNzF4gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Nzu8AsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1PXS-gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1IS--wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtNjyjggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglKX_qwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NiSvQgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1LSZxAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtIDq4ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1MKp5ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NO07QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NzuiAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1MeNkgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtOKnsAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1L-BtwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtKCguAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtJqEvQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglKX_ywkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglO2b2QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1MeN4gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Orl9gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtOqIkAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1JP7lQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1KeylgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtJCAoAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglKX_qwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtPyKuAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtIGHvwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtNy09QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1LP89goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1IS-hwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1IqZiwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1M6ojAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1MX-jAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglJKukwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtLi_ogsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1IuRpgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1N7asAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglI_rsQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1JbQtQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1Jbl0wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NiS3QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglOaW6wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglKX_6wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtIC-8wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtK6e9QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtNjy9gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtPj99wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgtKCe7QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg1NSc-ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglP-trgoM


Bot(s) for this bug's original alert(s):

chromium-rel-mac-retina
chromium-rel-mac11
chromium-rel-mac11-air
chromium-rel-mac11-pro
chromium-rel-mac12
chromium-rel-mac12-mini-8gb
chromium-rel-win10
chromium-rel-win7-dual
chromium-rel-win7-gpu-ati
chromium-rel-win7-gpu-intel
chromium-rel-win7-gpu-nvidia
chromium-rel-win7-x64-dual
chromium-rel-win8-dual
linux-release
win-high-dpi
Blocking: 698746
Cc: cbruni@chromium.org mythria@chromium.org
Status: Available (was: Untriaged)
That looks like the anticipated change in the performance profile: More time spent executing JavaScript, less time in Compilation and ICs. Overall a small net win.

Example: https://chromeperf.appspot.com/report?sid=87c972e75d611e2adc18911993f0506a94a884d74744c565427a702379685ca7
Cc: rmcilroy@chromium.org
Re #5, should we just make this wontfix then?
Project Member

Comment 8 by 42576172...@developer.gserviceaccount.com, Mar 13 2017

Mergedinto: 700364
Status: Duplicate (was: Available)

=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : Michael Hablich
  Commit : 7c3936c67a6361371d9a00d83e2c03ecc603ce76
  Date   : Thu Mar 09 08:05:42 2017
  Subject: Version 5.9.34.1 (Turn on I+TF)

Bisect Details
  Configuration: winx64intel_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop
  Metric       : JavaScript:duration_avg/browse_media/browse_media_youtube
  Change       : 24.65% | 501.798333333 -> 625.484333333

Revision                           Result                  N
chromium@455707                    501.798 +- 53.5957      6      good
chromium@455717                    508.44 +- 20.0501       6      good
chromium@455719                    517.525 +- 35.4576      6      good
chromium@455719,v8@7c3936c67a      623.464 +- 33.5665      6      bad       <--
chromium@455719,v8@fbffc377e3      694.453 +- 379.676      6      bad
chromium@455720                    623.956 +- 38.8809      6      bad
chromium@455722                    628.4 +- 46.5368        6      bad
chromium@455726                    638.262 +- 66.446       6      bad
chromium@455744                    623.075 +- 26.7482      6      bad
chromium@455781                    625.484 +- 21.6812      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.youtube v8.runtimestats.browsing_desktop

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8985245588612589184

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6461026788179968


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Re #7: If the alerts are as expected, yes. 
Filed a bug about autobisect (#8) btw: https://github.com/catapult-project/catapult/issues/3372
Project Member

Comment 11 by 42576172...@developer.gserviceaccount.com, Mar 13 2017


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : Michael Hablich
  Commit : 7c3936c67a6361371d9a00d83e2c03ecc603ce76
  Date   : Thu Mar 09 08:05:42 2017
  Subject: Version 5.9.34.1 (Turn on I+TF)

Bisect Details
  Configuration: mac_retina_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop
  Metric       : JavaScript:duration_avg/browse_media/browse_media_youtube
  Change       : 29.04% | 898.343 -> 1159.183

Revision                           Result                  N
chromium@455719                    898.343 +- 77.9937      6      good
chromium@455719,v8@7c3936c67a      1170.55 +- 96.8662      6      bad       <--
chromium@455719,v8@fbffc377e3      1163.8 +- 40.9735       6      bad
chromium@455720                    1156.29 +- 58.8088      6      bad
chromium@455721                    1174.53 +- 62.7686      6      bad
chromium@455723                    1170.78 +- 100.307      6      bad
chromium@455726                    1154.87 +- 75.1395      6      bad
chromium@455732                    1166.21 +- 35.0946      6      bad
chromium@455744                    1169.81 +- 78.3937      6      bad
chromium@455768                    1190.78 +- 115.214      6      bad
chromium@455816                    1159.18 +- 45.7426      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.youtube v8.runtimestats.browsing_desktop

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8985245521796685056

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6432107162763264


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Sign in to add a comment