New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 662017 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner:
Closed: Nov 2016
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

2.3%-100% regression in webrtc_perf_tests at 14815:14821

Project Member Reported by phoglund@chromium.org, Nov 3 2016

Issue description

Looks like the level controller tests have regressed to a new level. The graphs are a bit noisy, and maybe these tests are bit too sensitive? Commit positions 15-21 or so are implied, and this gives us this blamelist:

https://chromium.googlesource.com/external/webrtc/+log/48dfab5..c4b9b9419e441e188

c4b9b94 Revert of Replace FileWrapper with File (in audio_device) (patchset #3 id:40001 of https://codereview.webrtc.org/2386963003/ ) by terelius · 6 days ago
6ceab08 GN: New conventions, default target and refactorings by kjellander · 6 days ago
9f4a4a0 Add empty residual echo detector. by ivoc · 6 days ago
a9a1ac2 Moved rtc::Base64 to base approved. by philipel · 6 days ago
02ba211 Move RTCStatsCollector helper functions to anonymous namespace. by hbos · 6 days ago
f005a00 Added calling of the stream_analog_level api in audioproc_f by peah · 6 days ago
6d6762c Add UINavigationController and settings bar button to AppRTCMobile. by denicija · 6 days ago
5da65f2 Revert of Change ViEEncoder to not reconfigure the encoder until the video resolution is known. (patchset #4 id:60001 of https://codereview.webrtc.org/2455063002/ ) by perkj · 6 days ago
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=662017

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw67WsgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw5OcuwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw_jGvgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg9XmuQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw8P3pwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg_cvh4AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg5ectwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6D7twoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw87MsAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6PotgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-DgrgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw_ibqAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw8nsqwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg_av94gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg5PBrAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6O8rwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg-e5swsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-C0vwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg5OVvQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw4KFoQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6npuQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg5OLogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw86aqQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg6za4AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6nEoAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6n9pAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg__stAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw8OTugkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw5WsqAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6mntQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-mwrAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-CqoQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg5XPoAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6OmvgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw_j_uQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw86BuAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw8nfvgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg5PvswoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw9aGowkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-q5owoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw4KTsAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg_Hs7AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-nMvQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw5XauQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw87lpQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg__s9AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-C-sAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg9XmuQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-DFqQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg6f8oAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg_ulvwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-qjsgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6OxoAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-rXqwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw_y7uwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw_KM-goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-naogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-DTuAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6PNsQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw87ztAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg9P4qgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg__s9AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw5rIugoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg5eGrgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-naogkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw5XBpAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg5fhvwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw_KM-gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg6PfpwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw5rIugkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg9OiuwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg4fC-AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6qmoQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-mBswoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw5rIugsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg9Xm-QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw7yzpAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw87lpQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6PbqAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw_ibqAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg9O2pgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6nEoAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg9OiuwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw4TkpAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-mVqgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-OAuQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-nzuwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw8P3pwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg7Gy4AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw5qGtgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6nE4AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw8LRrQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg_-fqwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw5XvvQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg-fuogkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg5GKuAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw4SurAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw_bspAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg4ftrQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw9WiswoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-C0vwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw5PIqgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg9fOtAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg9eZrQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6PotgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-SwvAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg_OWsgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw-LIoAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg7-XuAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg43ktAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw6CdpgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw9POuAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgo4DZtQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgo_zHqQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg7WKswkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw4LKrgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw8OTugoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgg5fIpgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw_a69QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw4LUtwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgw4KevwoM


Bot(s) for this bug's original alert(s):

webrtc-mac-large-tests
Similar to https://bugs.chromium.org/p/chromium/issues/detail?id=659767.

... And they're just on a single bot, which lowers confidence in these results. If they're true, this regression looks to be mac only.
Cc: ivoc@chromium.org kjellander@chromium.org hbos@chromium.org denicija@chromium.org philipel@chromium.org perkj@chromium.org
cc:ing authors in the blame range.
I filed several perf bugs last week for level controller metrics, so I think this may be a continuation of those... I'm quite sure my GN refactoring is innocent.

Comment 5 by peah@chromium.org, Nov 10 2016

Status: WontFix (was: Assigned)
It does not make sense that these regressions occur from this CL.
I think it is an issue with the test and I have filed a webrtc bug for this (https://bugs.chromium.org/p/webrtc/issues/detail?id=6685)


I will close this issue, as the absolute size of the regressions is small. 

Sign in to add a comment