Issue metadata
Sign in to add a comment
|
10.8%-56.8% regression in performance_browser_tests at 383087:383126 |
||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Mar 25 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Value Std. Dev. Num Values Good? chromium@383095 37.924306 0.210981 18 good chromium@383125 38.152037 0.673711 12 bad Bisect job ran on: win_perf_bisect Bug ID: 598026 Test Command: .\src\out\Release\performance_browser_tests.exe --test-launcher-print-test-stdio=always --enable-gpu Test Metric: TabCapturePerformance_comp_gpu_webrtc/CaptureSucceeded Relative Change: 0.59% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/win_perf_bisect/builds/6437 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9017190478619654736 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=598026 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Mar 28 2016
I kicked off a few more bisects on the most-regressed metrics.
,
Apr 8 2016
Seems to be the libvpx roll 09915545c43bac0776a0ad366960501eeb298995. marpan, are you right to take a look at this?
,
Apr 11 2016
,
Apr 11 2016
The CastV2Performance tests are explicitly testing end-to-end screen mirroring, and the "Encode" line in the graphs is measuring just the real-time encode (VP8) run time. It's pretty clear from the graphs that encode performance has regressed by about 15% on all machines.
,
Apr 11 2016
,
Apr 22 2016
Ping.
,
Apr 22 2016
We looked into the libvpx roll in #5, and the change that caused the CastV2Perf regression seems to be VP8 change (only VP8 change in that roll): https://chromium.googlesource.com/webm/libvpx.git/+/b198bcd528ef53b5b292255449f791d3f787496f But this VP8 change was needed to fix a deadlock/freeze issue for Hangouts: https://buganizer.corp.google.com/issues/27232610 So reverting it is not a good option. We have not found another suitable fix.
,
May 6 2016
How would you like to proceed? Do we need to accept the regression to avoid the deadlock issue, or should we keep it open and investigate an optimization?
,
May 6 2016
I think we need to accept the perf regression, as we need to avoid the deadlock issue. We don't currently have a fix for the perf regression.
,
May 13 2016
Assigning this to rschoen@chromium.org to take a decision. rschoen@, Should this be marked as won't fix as the regression is expected?
,
Jul 11 2016
Marking WontFix, as we don't have any other solution. |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by sullivan@chromium.org
, Mar 25 2016