Issue metadata
Sign in to add a comment
|
midi_unittests failure due to MidiManagerTest.CreateMidiManager UNKNOWN |
||||||||||||||||||||||||
Issue descriptionHappening on both M63 and ToT arm_64 Android Test Bots, arm 32 is ok: https://uberchromegw.corp.google.com/i/official.android/builders/test-official-arm_64/builds/1975/steps/Unit%20Test%3A%20midi_unittests/logs/stdio https://uberchromegw.corp.google.com/i/official.android/builders/test-official-arm_64/builds/1976/steps/Unit%20Test%3A%20midi_unittests/logs/stdio Logs: I 623.678s run_tests_on_device(00b2e661896b32e1) [ RUN ] MidiManagerTest.CreateMidiManager I 623.678s run_tests_on_device(00b2e661896b32e1) Finished running tests on this device. I 623.690s Main FINISHED TRY #2/3 I 623.690s Main 1 failed tests remain. I 623.690s Main STARTING TRY #3/3 I 623.690s Main Will run 1 tests on 1 devices: 00b2e661896b32e1 I 623.691s TimeoutThread-1-for-run_tests_on_device(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell '( pm dump org.chromium.native_test | grep dataDir=; echo "PIPESTATUS: ${PIPESTATUS[@]}" );echo %$?' I 625.561s TimeoutThread-1-for-run_tests_on_device(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell '( mkdir -p /sdcard/tmp-79bc5c3ad11d9 );echo %$?' I 625.662s run_tests_on_device(00b2e661896b32e1) flags: I 625.665s TimeoutThread-1-for-run_tests_on_device(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell '( ( p=org.chromium.native_test;am instrument -w -e "$p".NativeTestInstrumentationTestRunner.ShardNanoTimeout 120000000000 -e "$p".NativeTestInstrumentationTestRunner.NativeTestActivity "$p".NativeUnitTestActivity -e "$p".NativeTestInstrumentationTestRunner.Test MidiManagerTest.CreateMidiManager -e "$p".NativeTestInstrumentationTestRunner.StdoutFile /sdcard/temp_file-d20021e020fbf.gtest_out "$p"/"$p".NativeTestInstrumentationTestRunner )>/data/local/tmp/temp_file-86d9ab4391a09 2>&1 );echo %$?' I 685.717s run_tests_on_device(00b2e661896b32e1) Still working on StartInstrumentation(00b2e661896b32e1, org.chromium.native_test/org.chromium.native_test.NativeTestInstrumentationTestRunner, retries=0, extras={'org.chromium.native_test.NativeTestInstrumentationTestRunner.ShardNanoTimeout': 120000000000, 'org.chromium.native_test.NativeTestInstrumentationTestRunner.NativeTestActivity': 'org.chromium.native_test.NativeUnitTestActivity', 'org.chromium.native_test.NativeTestInstrumentationTestRunner.Test': 'MidiManagerTest.CreateMidiManager', 'org.chromium.native_test.NativeTestInstrumentationTestRunner.StdoutFile': '/sdcard/temp_file-d20021e020fbf.gtest_out'}, timeout=120.0, raw=False) C 745.671s run_tests_on_device(00b2e661896b32e1) Timed out. Dumping threads. C 745.672s run_tests_on_device(00b2e661896b32e1) ******************************************************************************** C 745.672s run_tests_on_device(00b2e661896b32e1) Stack dump for thread 'TimeoutThread-1-for-run_tests_on_device(00b2e661896b32e1)' C 745.672s run_tests_on_device(00b2e661896b32e1) ******************************************************************************** C 745.672s run_tests_on_device(00b2e661896b32e1) File: "/usr/lib/python2.7/threading.py", line 783, in __bootstrap C 745.672s run_tests_on_device(00b2e661896b32e1) self.__bootstrap_inner() C 745.673s run_tests_on_device(00b2e661896b32e1) File: "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner C 745.673s run_tests_on_device(00b2e661896b32e1) self.run() C 745.673s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/utils/reraiser_thread.py", line 81, in run C 745.673s run_tests_on_device(00b2e661896b32e1) self._ret = self._func(*self._args, **self._kwargs) C 745.673s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/utils/timeout_retry.py", line 150, in <lambda> C 745.673s run_tests_on_device(00b2e661896b32e1) child_thread = reraiser_thread.ReraiserThread(lambda: func(*args, **kwargs), C 745.673s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/decorators.py", line 47, in impl C 745.673s run_tests_on_device(00b2e661896b32e1) return f(*args, **kwargs) C 745.673s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/device_utils.py", line 1195, in StartInstrumentation C 745.673s run_tests_on_device(00b2e661896b32e1) large_output=True) C 745.673s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/decorators.py", line 51, in timeout_retry_wrapper C 745.674s run_tests_on_device(00b2e661896b32e1) return impl() C 745.674s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/decorators.py", line 47, in impl C 745.674s run_tests_on_device(00b2e661896b32e1) return f(*args, **kwargs) C 745.674s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/device_utils.py", line 1041, in RunShellCommand C 745.674s run_tests_on_device(00b2e661896b32e1) output = handle_large_output(cmd, large_output) C 745.674s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/device_utils.py", line 1006, in handle_large_output C 745.674s run_tests_on_device(00b2e661896b32e1) handle_large_command(cmd) C 745.674s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/device_utils.py", line 992, in handle_large_command C 745.674s run_tests_on_device(00b2e661896b32e1) return handle_check_return(cmd) C 745.674s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/device_utils.py", line 983, in handle_check_return C 745.674s run_tests_on_device(00b2e661896b32e1) return run(cmd) C 745.675s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/device_utils.py", line 979, in run C 745.675s run_tests_on_device(00b2e661896b32e1) return self.adb.Shell(cmd) C 745.675s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/sdk/adb_wrapper.py", line 505, in Shell C 745.675s run_tests_on_device(00b2e661896b32e1) output = self._RunDeviceAdbCmd(args, timeout, retries, check_error=False) C 745.675s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/sdk/adb_wrapper.py", line 301, in _RunDeviceAdbCmd C 745.675s run_tests_on_device(00b2e661896b32e1) check_error=check_error) C 745.675s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/decorators.py", line 51, in timeout_retry_wrapper C 745.675s run_tests_on_device(00b2e661896b32e1) return impl() C 745.675s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/decorators.py", line 47, in impl C 745.675s run_tests_on_device(00b2e661896b32e1) return f(*args, **kwargs) C 745.675s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/sdk/adb_wrapper.py", line 262, in _RunAdbCmd C 745.675s run_tests_on_device(00b2e661896b32e1) env=cls._ADB_ENV) C 745.676s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/utils/cmd_helper.py", line 392, in GetCmdStatusAndOutputWithTimeout C 745.676s run_tests_on_device(00b2e661896b32e1) for data in _IterProcessStdout(process, timeout=timeout): C 745.676s run_tests_on_device(00b2e661896b32e1) File: "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/utils/cmd_helper.py", line 254, in _IterProcessStdoutFcntl C 745.676s run_tests_on_device(00b2e661896b32e1) [child_fd], [], [], iter_aware_poll_interval) C 745.676s run_tests_on_device(00b2e661896b32e1) ******************************************************************************** E 745.676s run_tests_on_device(00b2e661896b32e1) gtest shard timed out. Traceback (most recent call last): File "/b/build/slave/test-offical-arm_64/build/src/build/android/pylib/local/device/local_device_gtest_run.py", line 180, in Run self._component, extras=extras, raw=False, **kwargs) File "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/android/decorators.py", line 57, in timeout_retry_wrapper retry_if_func=retry_if_func) File "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/utils/timeout_retry.py", line 157, in Run error_log_func=error_log_func) File "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/utils/reraiser_thread.py", line 186, in JoinAll self._JoinAll(watcher, timeout) File "/b/build/slave/test-offical-arm_64/build/src/third_party/catapult/devil/devil/utils/reraiser_thread.py", line 151, in _JoinAll (len(alive_threads), len(self._threads))) CommandTimeoutError: Timed out waiting for 1 of 1 threads. I 745.678s TimeoutThread-1-for-run_tests_on_device(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell '( TZ=utc ls -a -l /sdcard/ );echo %$?' I 745.843s TimeoutThread-1-for-delete_temporary_file(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell 'rm -f /data/local/tmp/temp_file-86d9ab4391a09' I 745.884s run_tests_on_device(00b2e661896b32e1) /sdcard/temp_file-d20021e020fbf.gtest_out size on device: 264 I 745.885s TimeoutThread-1-for-run_tests_on_device(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell '( TZ=utc ls -a -l /sdcard/ );echo %$?' I 746.008s TimeoutThread-1-for-run_tests_on_device(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell '( cat /sdcard/temp_file-d20021e020fbf.gtest_out );echo %$?' I 746.086s TimeoutThread-1-for-delete_temporary_file(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell 'rm -f /sdcard/temp_file-d20021e020fbf.gtest_out' I 746.086s TimeoutThread-1-for-delete_temporary_file(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell 'rm -f /data/user/0/org.chromium.native_test/temp_file-4267dfbf4b1eb.xml' I 746.086s TimeoutThread-1-for-run_tests_on_device(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell '( pm clear org.chromium.native_test );echo %$?' I 746.939s TimeoutThread-1-for-run_tests_on_device(00b2e661896b32e1) Setting permissions for org.chromium.native_test. I 746.939s TimeoutThread-1-for-run_tests_on_device(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell '( ( p=org.chromium.native_test;for q in android.permission.CAMERA android.permission.CHANGE_CONFIGURATION android.permission.READ_EXTERNAL_STORAGE android.permission.RECORD_AUDIO android.permission.WRITE_EXTERNAL_STORAGE;do pm grant "$p" "$q";echo "~X~$q~X~$?~X~";done )>/data/local/tmp/temp_file-5741f87561e5b 2>&1 );echo %$?' I 750.366s TimeoutThread-1-for-run_tests_on_device(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 pull /data/local/tmp/temp_file-5741f87561e5b /tmp/tmpMApowF/tmp_ReadFileWithPull I 750.413s TimeoutThread-1-for-delete_temporary_file(00b2e661896b32e1) [host]> /b/build/slave/test-offical-arm_64/build/src/third_party/android_tools/sdk/platform-tools/adb -s 00b2e661896b32e1 shell 'rm -f /data/local/tmp/temp_file-5741f87561e5b' I 750.415s run_tests_on_device(00b2e661896b32e1) >>ScopedMainEntryLogger I 750.415s run_tests_on_device(00b2e661896b32e1) Note: Google Test filter = MidiManagerTest.CreateMidiManager I 750.415s run_tests_on_device(00b2e661896b32e1) [==========] Running 1 test from 1 test case. I 750.415s run_tests_on_device(00b2e661896b32e1) [----------] Global test environment set-up. I 750.415s run_tests_on_device(00b2e661896b32e1) [----------] 1 test from MidiManagerTest I 750.415s run_tests_on_device(00b2e661896b32e1) [ RUN ] MidiManagerTest.CreateMidiManager I 750.416s run_tests_on_device(00b2e661896b32e1) Finished running tests on this device. I 750.419s Main FINISHED TRY #3/3 I 750.419s Main 1 failed tests remain. C 750.420s Main ******************************************************************************** C 750.420s Main Detailed Logs C 750.420s Main ******************************************************************************** C 750.420s Main [UNKNOWN] MidiManagerTest.CreateMidiManager: C 750.421s Main [ RUN ] MidiManagerTest.CreateMidiManager C 750.421s Main ******************************************************************************** C 750.421s Main Summary C 750.421s Main ******************************************************************************** C 750.421s Main [==========] 77 tests ran. C 750.421s Main [ PASSED ] 76 tests. C 750.421s Main [ FAILED ] 1 test, listed below: C 750.421s Main [ FAILED ] MidiManagerTest.CreateMidiManager (UNKNOWN)
,
Nov 20 2017
Probably, this depends on dynamic instantiation experiments. aluo@ Could you provide more information, such as when this failure started, how often, and which builders pass and which do not.
,
Nov 20 2017
Last passed test was 63.0.3226.0, first bad was 63.0.3231.0. I didn't find failures for this upstream. The official arm_64 tests are failing. In this range: https://chromium.googlesource.com/chromium/src/+log/63.0.3226.0..63.0.3231.0?pretty=fuller&n=10000 This cl looks like the culprit: https://chromium-review.googlesource.com/678696
,
Nov 27 2017
,
Nov 27 2017
aluo, do you know which devices are actually based on arm64? I'm afraid that the enabled new mode has a problem on arm64, but I'd know how many production devices actually run on arm64 platforms, and if I had a arm64 device for debugging.
,
Nov 27 2017
correction: It seems I have one. Pixel C looks based on arm64. > adb shell uname -a Linux localhost 3.18.0-gde0a1b4ab47 #1 SMP PREEMPT Mon Jul 17 03:15:53 UTC 2017 aarch64 And.... running the test on the device makes the device ... reboot :( Let me investigate.
,
Nov 27 2017
aluo: I have another question. Do we ship the Android Chrome arm64 build? My Pixel C runs on arm64, but Chrome version says it's 62.0.3202.84 (Official Build) (32-bit).
,
Nov 27 2017
Callstack is here. I tried this with multiple combinations of dynamic instantiation and native MIDI API flags. It looks if MIDI API flag is enabled, it crashes regardless of the dynamic instantiation mode, may be because of an unhandled exception in Java land? C 96.365s Main Stack Trace: C 96.365s Main RELADDR FUNCTION FILE:LINE C 96.365s Main 00000000001064ff logging::LogMessage::~LogMessage()+147 /ssd/chromium/src/base/logging.cc:581 C 96.365s Main 00000000000d2c0b base::android::CheckException(_JNIEnv*)+223 /ssd/chromium/src/base/android/jni_android.cc:232 C 96.365s Main v------> jni_generator::CheckException(_JNIEnv*) /ssd/chromium/src/base/android/jni_generator/jni_generator_helper.h:50 C 96.365s Main v------> midi::Java_MidiManagerAndroid_create(_JNIEnv*, long long) /ssd/chromium/src/out/android-arm64/gen/media/midi/midi_jni_headers/midi/jni/MidiManagerAndroid_jni.h:127 C 96.365s Main 00000000000a698b midi::MidiManagerAndroid::StartInitialization()+275 /ssd/chromium/src/media/midi/midi_manager_android.cc:69 C 96.366s Main 000000000009ec37 midi::MidiManager::StartSession(midi::MidiManagerClient*)+243 /ssd/chromium/src/media/midi/midi_manager.cc:164 C 96.366s Main 00000000000a3a5f midi::MidiService::StartSession(midi::MidiManagerClient*)+263 /ssd/chromium/src/media/midi/midi_service.cc:94 C 96.366s Main 00000000000897cb midi::(anonymous namespace)::MidiManagerTest_CreateMidiManager_Test::TestBody()+111 /ssd/chromium/src/media/midi/midi_manager_unittest.cc:307 C 96.366s Main 000000000035eef3 testing::Test::Run()+123 /ssd/chromium/src/third_party/googletest/src/googletest/src/gtest.cc:2472 C 96.366s Main 000000000035f5cb testing::TestInfo::Run()+159 /ssd/chromium/src/third_party/googletest/src/googletest/src/gtest.cc:2654 C 96.366s Main 000000000035f927 testing::TestCase::Run()+163 /ssd/chromium/src/third_party/googletest/src/googletest/src/gtest.cc:2772 C 96.366s Main 000000000036364b testing::internal::UnitTestImpl::RunAllTests()+523
,
Nov 27 2017
ThreadUtils.getUiThreadLooper() raises an Exception on running the test on arm64. Also, another issue is if an exception was not caught in Java side on being called from a native code, it causes a serious issue, such as device reboot. This is not Web MIDI specific, but seems to happen in everywhere in arm64 build, IIUC. I ran the trunk Chromium/arm64 under the same configuration, but it looks working. So, this problem seems to happen only on unit test. Also, I notice another minor issue 788684 . It's debug build only issue.
,
Nov 28 2017
issue 788684 was fixed, but this bug still can reproduce. Let me reset the owner tentatively. yhirano@ is also taking a look.
,
Nov 28 2017
re c7: arm64 shipped on Canary and Dev channels. Beta and Stable ship with arm32.
,
Nov 29 2017
,
Nov 29 2017
re c11: one more question. does it mean we are just running experiments on Canary and Dev, or it will goes to Beta after the next branch cut? If so, we may need to submit a quick code to disable the problematic code path on arm64 today or tomorrow.
,
Nov 29 2017
oops, sorry. we may not need a quick fix because this was an unit test only issue. but anyway it's useful to know if 64bit build goes to beta or not.
,
Dec 5 2017
,
Jan 30 2018
any eta for this?
,
Jan 31 2018
Is arm64 build stable enough to fix this kind of specific issues? My gut feeling is still base library is not stable enough, e.g. breakpad is causing the system reboot. If it is needed, I will file some bugs for arm64 builds, and make this bug depend on them.
,
Jan 31 2018
,
May 22 2018
Duping and unrestricting (I don't see anything secret here). |
|||||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||||
Comment 1 by aluo@chromium.org
, Nov 18 2017Status: Assigned (was: Untriaged)