Nothing to do with issue 687142.

This seems to be flaky, it has now failed on chromium.linux/Android Tests (dbg) builder, but is no longer failing on Marshmallow Tablet Tester

org.chromium.chrome.browser.media.ui.AutoplayMutedNotificationTest#testBasic has also failed on the Android Tests bot recently, see  issue 686592 .

 Issue 686592  has been merged into this issue.

This test was fine for months. Do we know when it started to be flaky?

FYI, we are still seeing this on Android builders:
https://uberchromegw.corp.google.com/i/chromium.webkit/builders/WebKit%20Linux%20Trusty/builds/22950

I am adding some debug information to see whether this comes from the tab still loading or whether we have missed an event.

Just to manage expectations: I won't be able to follow through with this bug. I am just sheriffing and trying to help the next person.

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/94b6a6cc23c9f4a4eec6b02ff702e94275dc56ee

commit 94b6a6cc23c9f4a4eec6b02ff702e94275dc56ee
Author: battre <battre@chromium.org>
Date: Wed Feb 08 10:53:26 2017

Add debug information for crbug.com/687143

Add debug information to see whether the tabs has not finished loading or
whether we missed an event.

TBR=dfalcantara@chromium.org
BUG=687143

Review-Url: https://codereview.chromium.org/2682693003
Cr-Commit-Position: refs/heads/master@{#448948}

[modify] https://crrev.com/94b6a6cc23c9f4a4eec6b02ff702e94275dc56ee/chrome/test/android/javatests/src/org/chromium/chrome/test/util/ChromeTabUtils.java

Failed in https://build.chromium.org/p/chromium.linux/builders/Android%20Tests%20(dbg)/builds/39899

Looking at the logs it seems like it's because the page hasn't loaded.
The debug log output is:

Tab information at time of failure -- url: null, final URL: http://127.0.0.1:49775/content/test/data/media/session/autoplay-muted.html, load progress: 100, is loading: false
	at org.chromium.chrome.test.util.ChromeTabUtils.waitForTabPageLoaded(ChromeTabUtils.java:84)

TBH, ChromeTabUtils is waiting for onPageLoadFinished which is not consistent with isLoading (when isLoading becomes false, onLoadStopped is called but not onPageLoadFinished) -- not sure what's the actual intent here. Seems like the tab has loaded but the page contents hasn't, whatever the difference is?

I could imagine that "stopped but not finished" means that there was some kind of failure?

onLoadStopped() seems to be triggered by WebContentsImpl::LoadingStateChanged() on native side. onPageLoadFinished() comes from TabAndroid::SwapTabContents() on the native side. +clamy@, could you as someone familiar with navigation please explain what these things mean and when are they not the same?

Pasting a link to the flakiness dashboard for convenience.
https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=chrome_public_test_apk&tests=AutoplayMutedNotificationTest%23testDoesNotReactToAudioFocus

I reported issue 681544 which is similar to that one. For me, the Android test helpers are listening to the wrong observer. They should listen to the equivalent of DidStopLoading, which is what other test helpers in the code do.

Assigning to author of the test https://codereview.chromium.org/2251073003

org.chromium.chrome.browser.media.ui.AutoplayMutedNotificationTest#testBasic (run #1):
junit.framework.AssertionFailedError: Page did not load.  Tab information at time of failure -- url: null, final URL: http://127.0.0.1:60032/content/test/data/media/session/autoplay-muted.html, load progress: 100, is loading: false
	at org.chromium.chrome.test.util.ChromeTabUtils.waitForTabPageLoaded(ChromeTabUtils.java:84)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.startMainActivityFromIntent(ChromeActivityTestCaseBase.java:473)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.startMainActivityWithURL(ChromeActivityTestCaseBase.java:429)
	at org.chromium.chrome.browser.media.ui.AutoplayMutedNotificationTest.startMainActivity(AutoplayMutedNotificationTest.java:85)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.setUp(ChromeActivityTestCaseBase.java:144)
	at org.chromium.chrome.browser.media.ui.AutoplayMutedNotificationTest.setUp(AutoplayMutedNotificationTest.java:74)
	at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161)
	at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)

I'm also seeing flakes for AutoplayMutedNotificationTest#testAutoplayMutedThenUnmute with a similar stack trace

https://build.chromium.org/p/chromium.linux/builders/Android%20Tests/builds/38807

org.chromium.chrome.browser.media.ui.AutoplayMutedNotificationTest#testAutoplayMutedThenUnmute (run #1):
junit.framework.AssertionFailedError: Page did not load.  Tab information at time of failure -- url: null, final URL: http://127.0.0.1:54327/content/test/data/media/session/autoplay-muted.html, load progress: 100, is loading: false
	at org.chromium.chrome.test.util.ChromeTabUtils.waitForTabPageLoaded(ChromeTabUtils.java:84)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.startMainActivityFromIntent(ChromeActivityTestCaseBase.java:473)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.startMainActivityWithURL(ChromeActivityTestCaseBase.java:429)
	at org.chromium.chrome.browser.media.ui.AutoplayMutedNotificationTest.startMainActivity(AutoplayMutedNotificationTest.java:85)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.setUp(ChromeActivityTestCaseBase.java:144)
	at org.chromium.chrome.browser.media.ui.AutoplayMutedNotificationTest.setUp(AutoplayMutedNotificationTest.java:74)
	at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161)
	at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)





And a very, very small number (2) flakes for AutoplayMutedNotificationTest#testDoesNotReactToAudioFocus with the same "Page did not load" failure.


Flakiness dashboard link: https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=chrome_public_test_apk&tests=AutoplayMutedNotificationTest

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/d41e1901f74d16f33d861ada539296044fec32c1

commit d41e1901f74d16f33d861ada539296044fec32c1
Author: twellington <twellington@chromium.org>
Date: Thu Mar 02 18:39:27 2017

Retry flaking AutoplayMutedNotificationTest#*

BUG=687143
TBR=mlamouri@chromium.org

Review-Url: https://codereview.chromium.org/2725193002
Cr-Commit-Position: refs/heads/master@{#454316}

[modify] https://crrev.com/d41e1901f74d16f33d861ada539296044fec32c1/chrome/android/javatests/src/org/chromium/chrome/browser/media/ui/AutoplayMutedNotificationTest.java