New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 716073 link

Starred by 2 users

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Android
Pri: 2
Type: Bug-Regression



Sign in to add a comment

chrome_public_test_apk failing tests intermittently on linux_android_rel_ng

Project Member Reported by kbr@chromium.org, Apr 27 2017

Issue description

On this tryserver:
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng?numbuilds=200

There are multiple builds which failed one test each in the chrome_public_test_apk step:

https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281263
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281252
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281238
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281224
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281219
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281184
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281148

The tests which fail are mostly different each time:

org.chromium.chrome.browser.widget.OverviewListLayoutTest#testModelSwitcherFunctionality
org.chromium.chrome.browser.CopylessPasteTest#testNoMeta (4 times)
org.chromium.chrome.browser.history.HistoryActivityTest#testOpenItem
org.chromium.chrome.browser.customtabs.CustomTabTabPersistenceIntegrationTest#testTabFilesDeletedOnClose

These all appear to be timeouts of some sort:

-----

java.lang.RuntimeException: java.util.concurrent.TimeoutException: Activity did not start as expected
	at org.chromium.chrome.test.ChromeActivityTestCommon.startActivityCompletely(ChromeActivityTestCommon.java:185)
	at org.chromium.chrome.test.ChromeActivityTestCommon.startMainActivityFromIntent(ChromeActivityTestCommon.java:378)
	at org.chromium.chrome.test.ChromeActivityTestCommon.startMainActivityWithURL(ChromeActivityTestCommon.java:346)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.startMainActivityWithURL(ChromeActivityTestCaseBase.java:261)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.startMainActivityFromLauncher(ChromeActivityTestCaseBase.java:252)
	at org.chromium.chrome.browser.widget.OverviewListLayoutTest.startMainActivity(OverviewListLayoutTest.java:100)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.setUp(ChromeActivityTestCaseBase.java:56)
	at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161)
	at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)
Caused by: java.util.concurrent.TimeoutException: Activity did not start as expected
	at org.chromium.base.test.util.CallbackHelper.waitForCallback(CallbackHelper.java:183)
	at org.chromium.base.test.util.CallbackHelper.waitForCallback(CallbackHelper.java:211)
	at org.chromium.chrome.test.ChromeActivityTestCommon.startActivityCompletely(ChromeActivityTestCommon.java:179)
	... 17 more

-----

java.util.concurrent.TimeoutException: waitForCallback timed out!
	at org.chromium.base.test.util.CallbackHelper.waitForCallback(CallbackHelper.java:183)
	at org.chromium.base.test.util.CallbackHelper.waitForCallback(CallbackHelper.java:219)
	at org.chromium.chrome.browser.CopylessPasteTest.testNoMeta(CopylessPasteTest.java:130)
	at java.lang.reflect.Method.invokeNative(Native Method)
	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.runTest(ChromeActivityTestCaseBase.java:381)
	at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161)
	at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)

-----

junit.framework.AssertionFailedError: Criteria not met in allotted time.
	at org.chromium.content.browser.test.util.CriteriaHelper.pollInstrumentationThread(CriteriaHelper.java:79)
	at org.chromium.content.browser.test.util.CriteriaHelper.pollUiThread(CriteriaHelper.java:117)
	at org.chromium.content.browser.test.util.CriteriaHelper.pollUiThread(CriteriaHelper.java:138)
	at org.chromium.chrome.browser.customtabs.CustomTabActivityTestBase.startActivityCompletely(CustomTabActivityTestBase.java:47)
	at org.chromium.chrome.browser.customtabs.CustomTabActivityTestBase.startCustomTabActivityWithIntent(CustomTabActivityTestBase.java:69)
	at org.chromium.chrome.browser.customtabs.CustomTabTabPersistenceIntegrationTest.startMainActivity(CustomTabTabPersistenceIntegrationTest.java:26)
	at org.chromium.chrome.test.ChromeActivityTestCaseBase.setUp(ChromeActivityTestCaseBase.java:56)
	at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161)
	at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)

-----

I see multiple other bugs filed about flakiness of this test suite, so apologize for any duplication, but this is affecting one of the tryservers and causing valid CLs like https://codereview.chromium.org/2849443002/ to be retried multiple times.

 
Owner: jbudorick@chromium.org
Status: Assigned (was: Untriaged)
This is probably a dupe of https://bugs.chromium.org/p/chromium/issues/detail?id=715972. Looking into it today.

Comment 2 by kbr@chromium.org, Apr 27 2017

Thanks. 
Looking at the failures & failure rates, this may not be symptomatic of anything other than CopylessPasteTest being a bit unstable. Failure rates of chrome_public_test_apk were normal this morning. I'll revisit this as necessary, but for now, https://bugs.chromium.org/p/chromium/issues/detail?id=716029 is the more urgent issue affecting LARNG.
Labels: -Pri-1 Pri-2

Comment 5 by kbr@chromium.org, Apr 29 2017

Not sure whether I'm just unlucky or whether many people are getting hit by this -- there are multiple failures of chrome_public_test_apk on https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng?numbuilds=200 right now but I'm not sure what percentage those are of tryjobs that actually ran tests -- but got hit by this again:

https://codereview.chromium.org/2852623003/
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/282582
https://chromium-swarm.appspot.com/task?id=35cf6b681c14e810&refresh=10&show_raw=1

Here's the tail end of the log. It looks like it was close to the 30 minute mark for this step so I'm guessing it hit a timeout. Otherwise it looks like it would have failed 4 tests.

--------

C 1780.322s Main  [  FAILED  ] 4 tests, listed below:
C 1780.322s Main  [  FAILED  ] org.chromium.chrome.browser.WebShareTest#testWebShareOriginTrialDisabled
C 1780.322s Main  [  FAILED  ] org.chromium.chrome.browser.banners.AppBannerManagerTest#testBlockedBannerDoesNotAppearAgainForMonths
C 1780.322s Main  [  FAILED  ] org.chromium.chrome.browser.download.DownloadActivityTest#testFilters
C 1780.322s Main  [  FAILED  ] org.chromium.chrome.browser.offlinepages.RecentTabsTest#testLastNPageSavedWhenTabSwitched
C 1780.322s Main  
C 1780.322s Main  4 FAILED TESTS
C 1780.322s Main  ********************************************************************************
I 1780.324s TimeoutThread-1-for-individual_device_tear_down(03d76a5f25204cc9)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03d76a5f25204cc9 shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?'
I 1780.324s TimeoutThread-1-for-individual_device_tear_down(06aa4be9003c3bd6)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06aa4be9003c3bd6 shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?'
I 1780.326s TimeoutThread-1-for-individual_device_tear_down(03a5d5a9f0e9459b)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03a5d5a9f0e9459b shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?'
I 1780.330s TimeoutThread-1-for-individual_device_tear_down(06ad2d37003b6c62)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad2d37003b6c62 shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?'
I 1780.333s TimeoutThread-1-for-individual_device_tear_down(06ab26de003b6baa)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ab26de003b6baa shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?'
I 1780.333s TimeoutThread-1-for-individual_device_tear_down(06ad8d5b003bbe88)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad8d5b003bbe88 shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?'
I 1780.347s TimeoutThread-1-for-individual_device_tear_down(06aa4be9003c3bd6)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06aa4be9003c3bd6 shell '( test -e /data/local/tmp/chrome-command-line );echo %$?'
I 1780.351s TimeoutThread-1-for-individual_device_tear_down(06ad2d37003b6c62)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad2d37003b6c62 shell '( test -e /data/local/tmp/chrome-command-line );echo %$?'
I 1780.360s TimeoutThread-1-for-individual_device_tear_down(03d76a5f25204cc9)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03d76a5f25204cc9 shell '( test -e /data/local/tmp/chrome-command-line );echo %$?'
I 1780.364s TimeoutThread-1-for-individual_device_tear_down(03a5d5a9f0e9459b)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03a5d5a9f0e9459b shell '( test -e /data/local/tmp/chrome-command-line );echo %$?'
I 1780.368s TimeoutThread-1-for-individual_device_tear_down(06ab26de003b6baa)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ab26de003b6baa shell '( test -e /data/local/tmp/chrome-command-line );echo %$?'
I 1780.371s TimeoutThread-1-for-individual_device_tear_down(06ad8d5b003bbe88)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad8d5b003bbe88 shell '( test -e /data/local/tmp/chrome-command-line );echo %$?'
I 1780.379s individual_device_tear_down(03d76a5f25204cc9)  Flags now set on the device: []
I 1780.379s TimeoutThread-1-for-individual_device_tear_down(03d76a5f25204cc9)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03d76a5f25204cc9 shell '( am clear-debug-app );echo %$?'
I 1780.380s individual_device_tear_down(06aa4be9003c3bd6)  Flags now set on the device: []
I 1780.380s TimeoutThread-1-for-individual_device_tear_down(06aa4be9003c3bd6)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06aa4be9003c3bd6 shell '( am clear-debug-app );echo %$?'
I 1780.382s individual_device_tear_down(03a5d5a9f0e9459b)  Flags now set on the device: []
I 1780.384s TimeoutThread-1-for-individual_device_tear_down(03a5d5a9f0e9459b)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03a5d5a9f0e9459b shell '( am clear-debug-app );echo %$?'
I 1780.385s individual_device_tear_down(06ab26de003b6baa)  Flags now set on the device: []
I 1780.386s TimeoutThread-1-for-individual_device_tear_down(06ab26de003b6baa)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ab26de003b6baa shell '( am clear-debug-app );echo %$?'
I 1780.389s individual_device_tear_down(06ad8d5b003bbe88)  Flags now set on the device: []
I 1780.391s TimeoutThread-1-for-individual_device_tear_down(06ad8d5b003bbe88)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad8d5b003bbe88 shell '( am clear-debug-app );echo %$?'
I 1780.392s individual_device_tear_down(06ad2d37003b6c62)  Flags now set on the device: []
I 1780.396s TimeoutThread-1-for-individual_device_tear_down(06ad2d37003b6c62)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad2d37003b6c62 shell '( am clear-debug-app );echo %$?'
I 1780.991s TimeoutThread-1-for-individual_device_tear_down(06ab26de003b6baa)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ab26de003b6baa shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?'
I 1780.995s TimeoutThread-1-for-individual_device_tear_down(03a5d5a9f0e9459b)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03a5d5a9f0e9459b shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?'
I 1780.996s TimeoutThread-1-for-individual_device_tear_down(06ad8d5b003bbe88)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad8d5b003bbe88 shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?'
I 1781.014s TimeoutThread-1-for-individual_device_tear_down(06aa4be9003c3bd6)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06aa4be9003c3bd6 shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?'
I 1781.014s TimeoutThread-1-for-individual_device_tear_down(03d76a5f25204cc9)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03d76a5f25204cc9 shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?'
I 1781.117s TimeoutThread-1-for-individual_device_tear_down(06ad2d37003b6c62)  [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad2d37003b6c62 shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?'
I 1781.164s tear_down_device(03a5d5a9f0e9459b)  Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_03a5d5a9f0e9459b.json
I 1781.165s tear_down_device(06aa4be9003c3bd6)  Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_06aa4be9003c3bd6.json
I 1781.165s tear_down_device(06ab26de003b6baa)  Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_06ab26de003b6baa.json
I 1781.166s tear_down_device(03d76a5f25204cc9)  Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_03d76a5f25204cc9.json
I 1781.166s tear_down_device(06ad2d37003b6c62)  Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_06ad2d37003b6c62.json
I 1781.167s tear_down_device(06ad8d5b003bbe88)  Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_06ad8d5b003bbe88.json
I 1790.258s Main  Opening text logdog stream, unified_logcats
ERROR:root:Forwarding signal 15 to test process
[W2017-04-28T15:59:13.054301-07:00 25486 0 butler.go:240] Butler Context was cancelled. Initiating shutdown. {"error":"context canceled"}
[E2017-04-28T15:59:13.075989-07:00 25486 0 subcommand_run.go:333] Command completed with non-zero return code. {"returnCode":-1}
[E2017-04-28T15:59:14.436844-07:00 25486 0 stream.go:67] Stream encountered error during Read.       {"error":"read unix /b/swarm_slave/w/itj009v0/tmp_android_logdog_wrapperi5GTQf/butler.sock->@: use of closed network connection", "stream":"unified_logcats"}
[E2017-04-28T15:59:14.819935-07:00 25486 0 main.go:205] Butler terminated with error.               {"error":"context canceled"}
[E2017-04-28T15:59:14.826174-07:00 25486 0 main.go:233] Error running bootstrapped Butler process:
original error: context canceled

[I2017-04-28T15:59:14.826286-07:00 25486 0 main.go:349] Terminating.                                {"returnCode":-1}

CopylessPasteTest.testNoMeta is https://bugs.chromium.org/p/chromium/issues/detail?id=713895. Disabled on Friday.
Components: Infra>Client>Chrome
Moving Infra>Client>Android -> Infra>Client>Chrome+OS=Android
Components: -Infra>Client>Android

Sign in to add a comment