Issue metadata
Sign in to add a comment
|
chrome_public_test_apk failing tests intermittently on linux_android_rel_ng |
||||||||||||||||||||
Issue descriptionOn this tryserver: https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng?numbuilds=200 There are multiple builds which failed one test each in the chrome_public_test_apk step: https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281263 https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281252 https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281238 https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281224 https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281219 https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281184 https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/281148 The tests which fail are mostly different each time: org.chromium.chrome.browser.widget.OverviewListLayoutTest#testModelSwitcherFunctionality org.chromium.chrome.browser.CopylessPasteTest#testNoMeta (4 times) org.chromium.chrome.browser.history.HistoryActivityTest#testOpenItem org.chromium.chrome.browser.customtabs.CustomTabTabPersistenceIntegrationTest#testTabFilesDeletedOnClose These all appear to be timeouts of some sort: ----- java.lang.RuntimeException: java.util.concurrent.TimeoutException: Activity did not start as expected at org.chromium.chrome.test.ChromeActivityTestCommon.startActivityCompletely(ChromeActivityTestCommon.java:185) at org.chromium.chrome.test.ChromeActivityTestCommon.startMainActivityFromIntent(ChromeActivityTestCommon.java:378) at org.chromium.chrome.test.ChromeActivityTestCommon.startMainActivityWithURL(ChromeActivityTestCommon.java:346) at org.chromium.chrome.test.ChromeActivityTestCaseBase.startMainActivityWithURL(ChromeActivityTestCaseBase.java:261) at org.chromium.chrome.test.ChromeActivityTestCaseBase.startMainActivityFromLauncher(ChromeActivityTestCaseBase.java:252) at org.chromium.chrome.browser.widget.OverviewListLayoutTest.startMainActivity(OverviewListLayoutTest.java:100) at org.chromium.chrome.test.ChromeActivityTestCaseBase.setUp(ChromeActivityTestCaseBase.java:56) at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161) at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176) at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554) at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701) Caused by: java.util.concurrent.TimeoutException: Activity did not start as expected at org.chromium.base.test.util.CallbackHelper.waitForCallback(CallbackHelper.java:183) at org.chromium.base.test.util.CallbackHelper.waitForCallback(CallbackHelper.java:211) at org.chromium.chrome.test.ChromeActivityTestCommon.startActivityCompletely(ChromeActivityTestCommon.java:179) ... 17 more ----- java.util.concurrent.TimeoutException: waitForCallback timed out! at org.chromium.base.test.util.CallbackHelper.waitForCallback(CallbackHelper.java:183) at org.chromium.base.test.util.CallbackHelper.waitForCallback(CallbackHelper.java:219) at org.chromium.chrome.browser.CopylessPasteTest.testNoMeta(CopylessPasteTest.java:130) at java.lang.reflect.Method.invokeNative(Native Method) at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214) at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199) at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192) at org.chromium.chrome.test.ChromeActivityTestCaseBase.runTest(ChromeActivityTestCaseBase.java:381) at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161) at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176) at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554) at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701) ----- junit.framework.AssertionFailedError: Criteria not met in allotted time. at org.chromium.content.browser.test.util.CriteriaHelper.pollInstrumentationThread(CriteriaHelper.java:79) at org.chromium.content.browser.test.util.CriteriaHelper.pollUiThread(CriteriaHelper.java:117) at org.chromium.content.browser.test.util.CriteriaHelper.pollUiThread(CriteriaHelper.java:138) at org.chromium.chrome.browser.customtabs.CustomTabActivityTestBase.startActivityCompletely(CustomTabActivityTestBase.java:47) at org.chromium.chrome.browser.customtabs.CustomTabActivityTestBase.startCustomTabActivityWithIntent(CustomTabActivityTestBase.java:69) at org.chromium.chrome.browser.customtabs.CustomTabTabPersistenceIntegrationTest.startMainActivity(CustomTabTabPersistenceIntegrationTest.java:26) at org.chromium.chrome.test.ChromeActivityTestCaseBase.setUp(ChromeActivityTestCaseBase.java:56) at org.chromium.base.test.BaseTestResult.runParameterized(BaseTestResult.java:161) at org.chromium.base.test.BaseTestResult.run(BaseTestResult.java:124) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176) at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554) at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701) ----- I see multiple other bugs filed about flakiness of this test suite, so apologize for any duplication, but this is affecting one of the tryservers and causing valid CLs like https://codereview.chromium.org/2849443002/ to be retried multiple times.
,
Apr 27 2017
Thanks.
,
Apr 28 2017
Looking at the failures & failure rates, this may not be symptomatic of anything other than CopylessPasteTest being a bit unstable. Failure rates of chrome_public_test_apk were normal this morning. I'll revisit this as necessary, but for now, https://bugs.chromium.org/p/chromium/issues/detail?id=716029 is the more urgent issue affecting LARNG.
,
Apr 28 2017
,
Apr 29 2017
Not sure whether I'm just unlucky or whether many people are getting hit by this -- there are multiple failures of chrome_public_test_apk on https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng?numbuilds=200 right now but I'm not sure what percentage those are of tryjobs that actually ran tests -- but got hit by this again: https://codereview.chromium.org/2852623003/ https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/282582 https://chromium-swarm.appspot.com/task?id=35cf6b681c14e810&refresh=10&show_raw=1 Here's the tail end of the log. It looks like it was close to the 30 minute mark for this step so I'm guessing it hit a timeout. Otherwise it looks like it would have failed 4 tests. -------- C 1780.322s Main [ FAILED ] 4 tests, listed below: C 1780.322s Main [ FAILED ] org.chromium.chrome.browser.WebShareTest#testWebShareOriginTrialDisabled C 1780.322s Main [ FAILED ] org.chromium.chrome.browser.banners.AppBannerManagerTest#testBlockedBannerDoesNotAppearAgainForMonths C 1780.322s Main [ FAILED ] org.chromium.chrome.browser.download.DownloadActivityTest#testFilters C 1780.322s Main [ FAILED ] org.chromium.chrome.browser.offlinepages.RecentTabsTest#testLastNPageSavedWhenTabSwitched C 1780.322s Main C 1780.322s Main 4 FAILED TESTS C 1780.322s Main ******************************************************************************** I 1780.324s TimeoutThread-1-for-individual_device_tear_down(03d76a5f25204cc9) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03d76a5f25204cc9 shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?' I 1780.324s TimeoutThread-1-for-individual_device_tear_down(06aa4be9003c3bd6) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06aa4be9003c3bd6 shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?' I 1780.326s TimeoutThread-1-for-individual_device_tear_down(03a5d5a9f0e9459b) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03a5d5a9f0e9459b shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?' I 1780.330s TimeoutThread-1-for-individual_device_tear_down(06ad2d37003b6c62) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad2d37003b6c62 shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?' I 1780.333s TimeoutThread-1-for-individual_device_tear_down(06ab26de003b6baa) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ab26de003b6baa shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?' I 1780.333s TimeoutThread-1-for-individual_device_tear_down(06ad8d5b003bbe88) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad8d5b003bbe88 shell '( rm -f /data/local/tmp/chrome-command-line );echo %$?' I 1780.347s TimeoutThread-1-for-individual_device_tear_down(06aa4be9003c3bd6) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06aa4be9003c3bd6 shell '( test -e /data/local/tmp/chrome-command-line );echo %$?' I 1780.351s TimeoutThread-1-for-individual_device_tear_down(06ad2d37003b6c62) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad2d37003b6c62 shell '( test -e /data/local/tmp/chrome-command-line );echo %$?' I 1780.360s TimeoutThread-1-for-individual_device_tear_down(03d76a5f25204cc9) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03d76a5f25204cc9 shell '( test -e /data/local/tmp/chrome-command-line );echo %$?' I 1780.364s TimeoutThread-1-for-individual_device_tear_down(03a5d5a9f0e9459b) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03a5d5a9f0e9459b shell '( test -e /data/local/tmp/chrome-command-line );echo %$?' I 1780.368s TimeoutThread-1-for-individual_device_tear_down(06ab26de003b6baa) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ab26de003b6baa shell '( test -e /data/local/tmp/chrome-command-line );echo %$?' I 1780.371s TimeoutThread-1-for-individual_device_tear_down(06ad8d5b003bbe88) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad8d5b003bbe88 shell '( test -e /data/local/tmp/chrome-command-line );echo %$?' I 1780.379s individual_device_tear_down(03d76a5f25204cc9) Flags now set on the device: [] I 1780.379s TimeoutThread-1-for-individual_device_tear_down(03d76a5f25204cc9) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03d76a5f25204cc9 shell '( am clear-debug-app );echo %$?' I 1780.380s individual_device_tear_down(06aa4be9003c3bd6) Flags now set on the device: [] I 1780.380s TimeoutThread-1-for-individual_device_tear_down(06aa4be9003c3bd6) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06aa4be9003c3bd6 shell '( am clear-debug-app );echo %$?' I 1780.382s individual_device_tear_down(03a5d5a9f0e9459b) Flags now set on the device: [] I 1780.384s TimeoutThread-1-for-individual_device_tear_down(03a5d5a9f0e9459b) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03a5d5a9f0e9459b shell '( am clear-debug-app );echo %$?' I 1780.385s individual_device_tear_down(06ab26de003b6baa) Flags now set on the device: [] I 1780.386s TimeoutThread-1-for-individual_device_tear_down(06ab26de003b6baa) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ab26de003b6baa shell '( am clear-debug-app );echo %$?' I 1780.389s individual_device_tear_down(06ad8d5b003bbe88) Flags now set on the device: [] I 1780.391s TimeoutThread-1-for-individual_device_tear_down(06ad8d5b003bbe88) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad8d5b003bbe88 shell '( am clear-debug-app );echo %$?' I 1780.392s individual_device_tear_down(06ad2d37003b6c62) Flags now set on the device: [] I 1780.396s TimeoutThread-1-for-individual_device_tear_down(06ad2d37003b6c62) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad2d37003b6c62 shell '( am clear-debug-app );echo %$?' I 1780.991s TimeoutThread-1-for-individual_device_tear_down(06ab26de003b6baa) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ab26de003b6baa shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?' I 1780.995s TimeoutThread-1-for-individual_device_tear_down(03a5d5a9f0e9459b) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03a5d5a9f0e9459b shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?' I 1780.996s TimeoutThread-1-for-individual_device_tear_down(06ad8d5b003bbe88) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad8d5b003bbe88 shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?' I 1781.014s TimeoutThread-1-for-individual_device_tear_down(06aa4be9003c3bd6) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06aa4be9003c3bd6 shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?' I 1781.014s TimeoutThread-1-for-individual_device_tear_down(03d76a5f25204cc9) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 03d76a5f25204cc9 shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?' I 1781.117s TimeoutThread-1-for-individual_device_tear_down(06ad2d37003b6c62) [host]> /b/swarm_slave/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 06ad2d37003b6c62 shell '( su -c sh -c '"'"'rm -f /data/local/tmp/chrome_timeout_scale'"'"' );echo %$?' I 1781.164s tear_down_device(03a5d5a9f0e9459b) Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_03a5d5a9f0e9459b.json I 1781.165s tear_down_device(06aa4be9003c3bd6) Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_06aa4be9003c3bd6.json I 1781.165s tear_down_device(06ab26de003b6baa) Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_06ab26de003b6baa.json I 1781.166s tear_down_device(03d76a5f25204cc9) Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_03d76a5f25204cc9.json I 1781.166s tear_down_device(06ad2d37003b6c62) Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_06ad2d37003b6c62.json I 1781.167s tear_down_device(06ad8d5b003bbe88) Wrote device cache: /b/swarm_slave/w/ir/out/Release/device_cache_06ad8d5b003bbe88.json I 1790.258s Main Opening text logdog stream, unified_logcats ERROR:root:Forwarding signal 15 to test process [W2017-04-28T15:59:13.054301-07:00 25486 0 butler.go:240] Butler Context was cancelled. Initiating shutdown. {"error":"context canceled"} [E2017-04-28T15:59:13.075989-07:00 25486 0 subcommand_run.go:333] Command completed with non-zero return code. {"returnCode":-1} [E2017-04-28T15:59:14.436844-07:00 25486 0 stream.go:67] Stream encountered error during Read. {"error":"read unix /b/swarm_slave/w/itj009v0/tmp_android_logdog_wrapperi5GTQf/butler.sock->@: use of closed network connection", "stream":"unified_logcats"} [E2017-04-28T15:59:14.819935-07:00 25486 0 main.go:205] Butler terminated with error. {"error":"context canceled"} [E2017-04-28T15:59:14.826174-07:00 25486 0 main.go:233] Error running bootstrapped Butler process: original error: context canceled [I2017-04-28T15:59:14.826286-07:00 25486 0 main.go:349] Terminating. {"returnCode":-1}
,
Apr 29 2017
LARNG execution time is https://bugs.chromium.org/p/chromium/issues/detail?id=716029.
,
May 1 2017
CopylessPasteTest.testNoMeta is https://bugs.chromium.org/p/chromium/issues/detail?id=713895. Disabled on Friday.
,
Dec 4 2017
Moving Infra>Client>Android -> Infra>Client>Chrome+OS=Android
,
Dec 4 2017
|
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by jbudorick@chromium.org
, Apr 27 2017Status: Assigned (was: Untriaged)