New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 614318 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 615483
Owner: ----
Closed: Jun 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Android
Pri: 2
Type: Bug



Sign in to add a comment

AwContentsClientFullScreenTest has flaky tests

Project Member Reported by mvanouwe...@chromium.org, May 24 2016

Issue description

Multiple bots:
Marshmallow Tablet Tester
Lollipop Phone Tester

Multiple tests:
AwContentsClientFullScreenTest#testHolePunchingSurfaceNotCreatedForClearVideo
AwContentsClientFullScreenTest#testOnShowCustomViewRemovesHolePunchingSurfaceForVideo
AwContentsClientFullScreenTest#testExitFullscreenEndsIfAppInvokesCallbackFromOnHideCustomView

Looks like they're timing out sometimes:
https://uberchromegw.corp.google.com/i/chromium.android/builders/Marshmallow%20Tablet%20Tester/builds/4013/steps/Instrumentation%20test%20android_webview_test_apk/logs/stdio


I  761.217s run_tests_on_device(0ac4bb5f)  detected failure in org.chromium.android_webview.test.AwContentsClientFullScreenTest#testHolePunchingSurfaceNotCreatedForClearVideo with {--webview-sandboxed-renderer}. raw output:
I  761.217s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: numtests=1
I  761.217s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: stream=
I  761.218s run_tests_on_device(0ac4bb5f)    org.chromium.android_webview.test.AwContentsClientFullScreenTest:
I  761.218s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: id=InstrumentationTestRunner
I  761.218s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: test=testHolePunchingSurfaceNotCreatedForClearVideo
I  761.218s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: class=org.chromium.android_webview.test.AwContentsClientFullScreenTest
I  761.218s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: current=1
I  761.218s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS_CODE: 1
I  761.218s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: numtests=1
I  761.218s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: stream=
I  761.218s run_tests_on_device(0ac4bb5f)    Failure in testHolePunchingSurfaceNotCreatedForClearVideo:
I  761.218s run_tests_on_device(0ac4bb5f)    junit.framework.AssertionFailedError: Criteria not met in allotted time.
I  761.218s run_tests_on_device(0ac4bb5f)    	at org.chromium.content.browser.test.util.CriteriaHelper.pollInstrumentationThread(CriteriaHelper.java:74)
I  761.218s run_tests_on_device(0ac4bb5f)    	at org.chromium.content.browser.test.util.DOMUtils.waitForMediaPlay(DOMUtils.java:105)
I  761.218s run_tests_on_device(0ac4bb5f)    	at org.chromium.android_webview.test.AwContentsClientFullScreenTest.testHolePunchingSurfaceNotCreatedForClearVideo(AwContentsClientFullScreenTest.java:206)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
I  761.218s run_tests_on_device(0ac4bb5f)    	at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161)
I  761.218s run_tests_on_device(0ac4bb5f)    	at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:555)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1879)
I  761.218s run_tests_on_device(0ac4bb5f)    
I  761.218s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: id=InstrumentationTestRunner
I  761.218s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: test=testHolePunchingSurfaceNotCreatedForClearVideo
I  761.218s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: class=org.chromium.android_webview.test.AwContentsClientFullScreenTest
I  761.218s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: stack=junit.framework.AssertionFailedError: Criteria not met in allotted time.
I  761.218s run_tests_on_device(0ac4bb5f)    	at org.chromium.content.browser.test.util.CriteriaHelper.pollInstrumentationThread(CriteriaHelper.java:74)
I  761.218s run_tests_on_device(0ac4bb5f)    	at org.chromium.content.browser.test.util.DOMUtils.waitForMediaPlay(DOMUtils.java:105)
I  761.218s run_tests_on_device(0ac4bb5f)    	at org.chromium.android_webview.test.AwContentsClientFullScreenTest.testHolePunchingSurfaceNotCreatedForClearVideo(AwContentsClientFullScreenTest.java:206)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
I  761.218s run_tests_on_device(0ac4bb5f)    	at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161)
I  761.218s run_tests_on_device(0ac4bb5f)    	at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
I  761.218s run_tests_on_device(0ac4bb5f)    	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
I  761.219s run_tests_on_device(0ac4bb5f)    	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:555)
I  761.219s run_tests_on_device(0ac4bb5f)    	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1879)
I  761.219s run_tests_on_device(0ac4bb5f)    
I  761.219s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS: current=1
I  761.219s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_STATUS_CODE: -2
I  761.219s run_tests_on_device(0ac4bb5f)    INSTRUMENTATION_RESULT: stream=
I  761.219s run_tests_on_device(0ac4bb5f)    Test results for AwInstrumentationTestRunner=.F
I  761.219s run_tests_on_device(0ac4bb5f)    Time: 11.715
I  761.219s run_tests_on_device(0ac4bb5f)    
I  761.219s run_tests_on_device(0ac4bb5f)    FAILURES!!!
I  761.219s run_tests_on_device(0ac4bb5f)    Tests run: 1,  Failures: 1,  Errors: 0
 
Components: Tests>Flaky
Project Member

Comment 2 by bugdroid1@chromium.org, May 24 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/22a7f8467da532e4ab9f07256de4a11e93888341

commit 22a7f8467da532e4ab9f07256de4a11e93888341
Author: mvanouwerkerk <mvanouwerkerk@chromium.org>
Date: Tue May 24 13:34:18 2016

Mark some AwContentsClientFullScreenTest tests flaky.

BUG= 614318 

Review-Url: https://codereview.chromium.org/2011453002
Cr-Commit-Position: refs/heads/master@{#395588}

[modify] https://crrev.com/22a7f8467da532e4ab9f07256de4a11e93888341/android_webview/javatests/src/org/chromium/android_webview/test/AwContentsClientFullScreenTest.java

Comment 3 by hush@chromium.org, Jun 3 2016

Cc: hush@chromium.org boliu@chromium.org
This another multiprocess flaky test 

Comment 4 by boliu@chromium.org, Jun 3 2016

Mergedinto: 615483
Status: Duplicate (was: Untriaged)
Project Member

Comment 5 by bugdroid1@chromium.org, Jun 4 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/63d6ee6f55ea3a0752620eb7695ed871deca407c

commit 63d6ee6f55ea3a0752620eb7695ed871deca407c
Author: boliu <boliu@chromium.org>
Date: Sat Jun 04 00:42:15 2016

Revert of Mark some AwContentsClientFullScreenTest tests flaky. (patchset #2 id:20001 of https://codereview.chromium.org/2011453002/ )

Reason for revert:
Avoid disabling these tests on CQ

Original issue's description:
> Mark some AwContentsClientFullScreenTest tests flaky.
>
> BUG= 614318 
>
> Committed: https://crrev.com/22a7f8467da532e4ab9f07256de4a11e93888341
> Cr-Commit-Position: refs/heads/master@{#395588}

TBR=torne@chromium.org,mvanouwerkerk@chromium.org
# Not skipping CQ checks because original CL landed more than 1 days ago.
BUG= 614318 

Review-Url: https://codereview.chromium.org/2039463004
Cr-Commit-Position: refs/heads/master@{#397859}

[modify] https://crrev.com/63d6ee6f55ea3a0752620eb7695ed871deca407c/android_webview/javatests/src/org/chromium/android_webview/test/AwContentsClientFullScreenTest.java

Sign in to add a comment