Issue metadata
Sign in to add a comment
|
Performance worse on OSX 10.11 than 10.9 |
||||||||||||||||||||
Issue descriptionWe just upgraded the MacBook retina pros in the perf lab from 10.9 to 10.11, and they are showing some big regressions in performance. I'm noticing regressions in page load time, startup, smoothness, and memory.
,
Jul 28 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005891318104163056
,
Jul 28 2016
Note that the bisects will have no effect since this is caused by a change in OS on the bot. Assigning to shrike for triage and cc-ing spqchan.
,
Jul 28 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@407959 12.8844 0.200508 18 good chromium@407961 12.8063 0.218285 18 bad Bisect job ran on: mac_retina_perf_bisect Bug ID: 632328 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests smoothness.top_25_smooth Test Metric: mean_input_event_latency/Wordpress Relative Change: 1.16% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_retina_perf_bisect/builds/1456 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005891318104163056 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5880960755695616 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jul 28 2016
Currently examining the graphs. Since this is an issue involving the OS, the culprit will be tricky to figure out
,
Aug 2 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005435616069964000
,
Aug 3 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005307023316685680
,
Aug 4 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005215860053898256
,
Aug 4 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@407938 12.7323 0.183187 18 good chromium@407983 12.7122 0.276932 18 bad Bisect job ran on: mac_retina_perf_bisect Bug ID: 632328 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests smoothness.top_25_smooth Test Metric: mean_input_event_latency/Wordpress Relative Change: 0.18% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_retina_perf_bisect/builds/1529 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005307023316685680 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5776131140091904 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 15 2016
A note on this: some research is ongoing in bug 636755 , and it appears these bots may possibly not have been running in retina mode on 10.9, which would at least partially explain the difference.
,
Sep 22 2016
Friend ping from perf sheriff
,
Oct 6 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8999531438131173136
,
Oct 6 2016
fixit ping: Shrike, can you follow up on this regression now that the potential blocker has been resolved?
,
Oct 6 2016
Note: I still think this was due to the switch to retina mode as per comment 10. shrike, should we close?
,
Oct 6 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@407959 463534 804.681 18 good chromium@408006 463708 650.251 18 bad Bisect job ran on: mac_retina_perf_bisect Bug ID: 632328 Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests page_cycler_site_isolation.basic_oopif Test Metric: vm_resident_set_size_final_size_total/vm_resident_set_size_final_size_total Relative Change: 0.12% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_retina_perf_bisect/builds/1725 Job details: https://chromeperf.appspot.com/buildbucket_job_status/8999531438131173136 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5574671435563008 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Oct 7 2016
erikchen@ - what are your thoughts?
,
Oct 7 2016
While there may be real 10.9 -> 10.11 regressions/improvements, they will be dwarfed by the non-retina -> retina change. Don't think there's anything to do here, and manual investigation is unlikely to be a good use of time. |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by sullivan@chromium.org
, Jul 28 2016