New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 692026 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner:
Last visit 16 days ago
Closed: Feb 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: ----



Sign in to add a comment

WebRtcAudioQualityBrowserTests failing on chromium.webrtc Win7 Tester

Project Member Reported by sakal@chromium.org, Feb 14 2017

Issue description

[ADD relevant info inline]

Link to build or pfq page.

build # for that buildbot.
https://build.chromium.org/p/chromium.webrtc/builders/Win7%20Tester/builds/33302
https://build.chromium.org/p/chromium.webrtc/builders/Win7%20Tester/builds/33303

Snippet of log that contains the failure.
4 tests failed:
    WebRtcAudioQualityBrowserTest.MANUAL_TestAutoGainControlOnLowAudio (e:\b\c\b\win_builder\src\chrome\browser\media\webrtc\webrtc_audio_quality_browsertest.cc:803)
    WebRtcAudioQualityBrowserTest.MANUAL_TestAutoGainIsOffWithAudioProcessingOff (e:\b\c\b\win_builder\src\chrome\browser\media\webrtc\webrtc_audio_quality_browsertest.cc:810)
    WebRtcAudioQualityBrowserTest.MANUAL_TestCallQualityWithAudioFromFakeDevice (e:\b\c\b\win_builder\src\chrome\browser\media\webrtc\webrtc_audio_quality_browsertest.cc:683)
    WebRtcAudioQualityBrowserTest.MANUAL_TestCallQualityWithAudioFromWebAudio (e:\b\c\b\win_builder\src\chrome\browser\media\webrtc\webrtc_audio_quality_browsertest.cc:688)

Corresponding bot on chromium.webrtc.fyi is working: https://build.chromium.org/p/chromium.webrtc.fyi/waterfall?builder=Win7%20Tester Maybe an infra issue?

No obvious cause in the blamelist.
 
Status: WontFix (was: Untriaged)
It has recovered now. Two green builds. This kind of mysterious breakages has happened before on Windows testers, so I'm afraid it's either infrastructure flakiness (although unlikely since these bots are strictly not modified unless we request so).

I guess it must have been another Chrome change that was later reverted that made it recover.

Comment 2 by sakal@chromium.org, Feb 15 2017

Status: Untriaged (was: WontFix)
It seems this just happened again:
https://build.chromium.org/p/chromium.webrtc/builders/Win7%20Tester/builds/33327

Comment 3 by sakal@chromium.org, Feb 17 2017

Status: WontFix (was: Untriaged)
Seems to be fine again.
Cc: maxmorin@chromium.org
Do we really intend to leave this as it is? Looking at https://build.chromium.org/p/chromium.webrtc/builders/Win7%20Tester?numbuilds=200, the bot/test seems to be flaking heavily.
Well. It has happened before and a lot of time has gone into investigating it. Since this test might be affected by other Chrome changes we cannot (and shouldn't) spend too much time on it if we don't know it's a WebRTC issue. That way I'm willing to "give it some time" when this happens, as it has recovered several times before:
*  bug 681577 
*  bug 677256 
* bug 672811

Long term, we probably should consider removing the test entirely instead, or spend time on making it more robust (but for that we need to know what's causing the failures). Adding more logging would be one option start with.

Sign in to add a comment