Issue metadata
Sign in to add a comment
|
9.3%-114.5% regression in webrtc_perf_tests at 16425:16428 |
||||||||||||||||||||
Issue descriptionMain culprit pointed to by perf tool is https://chromium.googlesource.com/external/webrtc/+/5f4712686550ba1d069c5e4c456ffcabe7ccba97 by ilnik@. Could possibly also be https://chromium.googlesource.com/external/webrtc/+/77ce9a55415a673422d424ed862be142d5e277ef by henrika@. I looked at the corresponding graphs for Linux and Windows, and they did not exhibit the same regression.
,
Feb 8 2017
My change should only affect full_stack_video tests and are OS independent. Since broken tests are audio tests I believe commit by henrika@ may be the main culprit, as it affects audio processing.
,
Feb 8 2017
hlundin@: what does these tests measure? My CL does not touch the audio path at all. It only moves some stat calculations used for logging from a task queue into audiocallbacks. And the calculations are trivial (only counters). In addition, my changes are platform agnostic and should have the same effect on all platforms if any effect existed. Not sure where to go from here.
,
Feb 8 2017
hlundin@: my CL landed in 16429 and judging from the graph that is after the jump. Do you agree?
,
Feb 8 2017
hlundin@: if I speculatively revert my change. Would that show up directly in the perf tool bot?
,
Feb 8 2017
Henrika@: From what I see, you introduced some locks and stats calculations in the audio device buffer. This might cause change in the tests. Especially, if tests did not count logging time before. Since increase is not huge in absolute values (in some tests its about 1us), it may not be a regression at all but just change in the way metrics are calculated because some code now is executed in the different thread.
,
Feb 8 2017
Re #5: Yes, a speculative revert would show up pretty soon. Probably within hours.
,
Feb 8 2017
I have committed a revert here: https://codereview.webrtc.org/2684913003/ Please note that my change should only improve things since I have shown with profiling that the old code added overhead by calling PostTask on a task queue for each audio packet and that does come with a cost. I am surprised if the limited usage of locks here would have a negative impact. Let's wait with all the details until the revert has landed. In any case, the intention of my change was to do good.
,
Feb 8 2017
Henrik L: could you help me keep track and report back what the effect of my revert was. Thanks.
,
Feb 8 2017
I will look at that. Thanks!
,
Feb 8 2017
Cr-Commit-Position: refs/heads/master@{#16490}
,
Feb 8 2017
Henrik A: You are off the hook. It looks like your CL is not to blame. Feel free to re-land.
,
Feb 8 2017
Reverted the revert. My CL is in again.
,
Feb 9 2017
Should I revert my commit? It makes even less sense, as it touches only video performance tests.
,
Feb 9 2017
This could be related to https://bugs.chromium.org/p/chromium/issues/detail?id=690358.
,
Feb 9 2017
Reverted my CL. Let's see.
,
Feb 9 2017
Revert broke some other tests, so I relanded changes later. But it looks like it really was my commit. I Will look into that further.
,
Feb 13 2017
I found the broken tests in /webrtc/modules/audio_processing/audio_processing_performance_unnitest.cc All my changes are contained within VideoQualityTest which is not referenced or used at all anywhere outside of video performance test. My changes are linked in the webrtc_perf_tests but aren't called at all. My code just couldn't cause regression unless there are some general problems like executable became too big or some other Mac magic. solenberg@ could you please try to reproduce the bug?
,
Feb 14 2017
Passing the hot potato to peah@, who wrote audio_processing_performance_unittest.cc.
,
Mar 6 2017
Removing R-V-G label (was set upon bug filing because the bot was incorrectly configured as internal)
,
Mar 6 2017
It does not make sense that these tests should fail due to that. But the size of the regression is so small so that it is not a concern. Closing as WontFix. |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by hlundin@chromium.org
, Feb 8 2017