twellington@: Since you're taking a look at the other ContextualSearchManagerTest test, PTAL for testTapOnRoleIgnored as well. Thanks!

Donn - can you take this one?

Looks like it has nothing to do with the particular test, the test page simply failed to load:

org.chromium.chrome.browser.contextualsearch.ContextualSearchManagerTest#testTapOnRoleIgnored (run #1):
junit.framework.AssertionFailedError: Failed to load URL: null, final URL: http://127.0.0.1:36600/chrome/test/data/android/contextualsearch/tap_test.html
	at org.chromium.chrome.test.util.ChromeTabUtils.waitForTabPageLoaded(ChromeTabUtils.java:84)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.startMainActivityFromIntent(ChromeActivityTestCaseBase.java:447)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.startMainActivityWithURL(ChromeActivityTestCaseBase.java:403)
	at org.chromium.chrome.browser.contextualsearch.ContextualSearchManagerTest.startMainActivity(ContextualSearchManagerTest.java:261)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.setUp(ChromeActivityTestCaseBase.java:139)
	at org.chromium.chrome.browser.contextualsearch.ContextualSearchManagerTest.setUp(ContextualSearchManagerTest.java:122)
	at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161)
	at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)

Is there a more robust way to load the test page than startMainActivityWithURL, or a way to retry when that fails?

We can add @RetryOnFailure to the test for now.

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/178b21a3089c78d3d4dbd3ccdcb7b967959ecf5a

commit 178b21a3089c78d3d4dbd3ccdcb7b967959ecf5a
Author: twellington <twellington@chromium.org>
Date: Tue Nov 29 18:43:32 2016

[Contextual Search] Fix flaky tests

Attempt to fix ContextualSearchManagerTest#testImageControl() by running
calls to the ContextualSearchImageControl on the UI thread. Also add
@RetryOnFailure to #testTapOnRoleIgnored().

BUG= 669405 , 669565 

Review-Url: https://codereview.chromium.org/2534193002
Cr-Commit-Position: refs/heads/master@{#435040}

[modify] https://crrev.com/178b21a3089c78d3d4dbd3ccdcb7b967959ecf5a/chrome/android/javatests/src/org/chromium/chrome/browser/contextualsearch/ContextualSearchManagerTest.java

Looks like this is being taken care of. -> taking this out of the sheriffing queue.