New issue
Advanced search Search tips

Issue 656815 link

Starred by 1 user

Issue metadata

Status: Archived
Owner: ----
Closed: Nov 2017
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Flaky tests in MediaPermissionsTest.java

Reported by calvi...@amazon.com, Oct 17 2016

Issue description

Chrome Version       : Any

What steps will reproduce the problem?
(1) Attach Kindle Fire HDX 8.9 device
(2) Run ./run_chrome_public_test_apk -v --num_retries=0 -f
    MediaPermissionsTest#testCameraPersistenceOn

What is the expected result?
The test passes

What happens instead?
C   71.878s Main  Detailed Logs
C   71.878s Main  ********************************************************************************
C   71.879s Main  [FAIL] org.chromium.chrome.browser.media.ui.MediaPermissionsTest#testCameraPersistenceOn:
C   71.879s Main  junit.framework.AssertionFailedError: InfoBar not added.
C   71.879s Main  	at org.chromium.chrome.browser.media.ui.MediaPermissionsTest.testMediaPermissionsPlumbing(MediaPermissionsTest.java:222)
C   71.879s Main  	at org.chromium.chrome.browser.media.ui.MediaPermissionsTest.testCameraPersistenceOn(MediaPermissionsTest.java:166)
C   71.879s Main  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
C   71.879s Main  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
C   71.879s Main  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
C   71.879s Main  	at org.chromium.chrome.test.ChromeActivityTestCaseBase.runTest(ChromeActivityTestCaseBase.java:726)
C   71.879s Main  	at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161)
C   71.879s Main  	at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124)
C   71.879s Main  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
C   71.879s Main  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
C   71.879s Main  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:557)
C   71.879s Main  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1874)
C   71.879s Main  ********************************************************************************
C   71.879s Main  Summary
C   71.880s Main  ********************************************************************************
C   71.880s Main  [==========] 1 test ran.
C   71.880s Main  [  PASSED  ] 0 tests.
C   71.880s Main  [  FAILED  ] 1 test, listed below:
C   71.880s Main  [  FAILED  ] org.chromium.chrome.browser.media.ui.MediaPermissionsTest#testCameraPersistenceOn
C   71.880s Main  
C   71.880s Main  1 FAILED TEST
C   71.880s Main  ********************************************************************************

Please provide any additional information below. Attach a screenshot if
possible.

The following tests are all flaky with the same failure: 
   - testCameraPersistenceOn
   - testCameraPersistenceOff
   - testCombinedPersistenceOn
   - testCombinedPersistenceOff

 

Comment 1 by calvi...@amazon.com, Oct 17 2016

Forgot to include that the MediaPermissionsTest.testMicrophonePersistence* tests are also flaky. Running these tests on the same device will yield:

C   25.920s Main  ********************************************************************************
C   25.920s Main  Detailed Logs
C   25.920s Main  ********************************************************************************
C   25.920s Main  [FAIL] org.chromium.chrome.browser.media.ui.MediaPermissionsTest#testMicrophonePersistenceOff:
C   25.920s Main  java.util.concurrent.TimeoutException: waitForCallback timed out!
C   25.920s Main  	at org.chromium.content.browser.test.util.CallbackHelper.waitForCallback(CallbackHelper.java:184)
C   25.920s Main  	at org.chromium.content.browser.test.util.CallbackHelper.waitForCallback(CallbackHelper.java:192)
C   25.920s Main  	at org.chromium.content.browser.test.util.CallbackHelper.waitForCallback(CallbackHelper.java:198)
C   25.920s Main  	at org.chromium.chrome.browser.media.ui.MediaPermissionsTest$MediaPermissionsUpdateWaiter.waitForNumUpdates(MediaPermissionsTest.java:68)
C   25.920s Main  	at org.chromium.chrome.browser.media.ui.MediaPermissionsTest.testMediaPermissionsPlumbing(MediaPermissionsTest.java:248)
C   25.920s Main  	at org.chromium.chrome.browser.media.ui.MediaPermissionsTest.testMicrophonePersistenceOff(MediaPermissionsTest.java:152)
C   25.920s Main  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
C   25.920s Main  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
C   25.921s Main  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
C   25.921s Main  	at org.chromium.chrome.test.ChromeActivityTestCaseBase.runTest(ChromeActivityTestCaseBase.java:726)
C   25.921s Main  	at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161)
C   25.921s Main  	at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124)
C   25.921s Main  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
C   25.921s Main  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
C   25.921s Main  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:557)
C   25.921s Main  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1874)
C   25.921s Main  ********************************************************************************
C   25.921s Main  Summary
C   25.921s Main  ********************************************************************************
C   25.921s Main  [==========] 1 test ran.
C   25.921s Main  [  PASSED  ] 0 tests.
C   25.921s Main  [  FAILED  ] 1 test, listed below:
C   25.922s Main  [  FAILED  ] org.chromium.chrome.browser.media.ui.MediaPermissionsTest#testMicrophonePersistenceOff
C   25.922s Main  
C   25.922s Main  1 FAILED TEST
C   25.922s Main  ********************************************************************************
Labels: TE-NeedsTraigeHelp
Project Member

Comment 3 by bugdroid1@chromium.org, Nov 8 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/7209a6e51b6a4afc887ba9a02e2a211cc0011b80

commit 7209a6e51b6a4afc887ba9a02e2a211cc0011b80
Author: tedchoc <tedchoc@chromium.org>
Date: Tue Nov 08 19:43:30 2016

Convert InfoBarTestAnimationListener to CallbackHelper.

In addition, this adds the ability to log a better error message
in CallbackHelper when the timeout fails.

BUG= 656815 

Review-Url: https://codereview.chromium.org/2487683003
Cr-Commit-Position: refs/heads/master@{#430686}

[modify] https://crrev.com/7209a6e51b6a4afc887ba9a02e2a211cc0011b80/base/test/android/javatests/src/org/chromium/base/test/util/CallbackHelper.java
[modify] https://crrev.com/7209a6e51b6a4afc887ba9a02e2a211cc0011b80/chrome/android/javatests/src/org/chromium/chrome/browser/infobar/InfoBarContainerTest.java
[modify] https://crrev.com/7209a6e51b6a4afc887ba9a02e2a211cc0011b80/chrome/android/javatests/src/org/chromium/chrome/browser/infobar/InfoBarTest.java
[modify] https://crrev.com/7209a6e51b6a4afc887ba9a02e2a211cc0011b80/chrome/android/javatests/src/org/chromium/chrome/browser/infobar/PermissionUpdateInfobarTest.java
[modify] https://crrev.com/7209a6e51b6a4afc887ba9a02e2a211cc0011b80/chrome/android/javatests/src/org/chromium/chrome/browser/permissions/PermissionTestCaseBase.java
[modify] https://crrev.com/7209a6e51b6a4afc887ba9a02e2a211cc0011b80/chrome/android/javatests/src/org/chromium/chrome/browser/preferences/website/SiteSettingsPreferencesTest.java
[modify] https://crrev.com/7209a6e51b6a4afc887ba9a02e2a211cc0011b80/chrome/android/javatests/src/org/chromium/chrome/browser/translate/TranslateInfoBarTest.java
[modify] https://crrev.com/7209a6e51b6a4afc887ba9a02e2a211cc0011b80/chrome/test/android/javatests/src/org/chromium/chrome/test/util/InfoBarTestAnimationListener.java

Project Member

Comment 4 by sheriffbot@chromium.org, Nov 9 2017

Status: Archived (was: Unconfirmed)
Issue has not been modified or commented on in the last 365 days, please re-open or file a new bug if this is still an issue.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Sign in to add a comment