peach_pit-paladin HWTest tast.security.UserFilesLoggedIn failed |
|||||
Issue description
HWTest failure occur to peach_pit-paladin with the following logs:
autoserv.DEBUG:
12/04 19:52:39.420 INFO | utils:0287| [stdout] --------------------------------------------------------------------------------
12/04 19:52:39.420 INFO | utils:0287| [stdout] security.UserFilesGuest [ PASS ]
12/04 19:52:39.420 INFO | utils:0287| [stdout] Run did not finish successfully; results are incomplete
12/04 19:52:39.420 INFO | utils:0287| [stdout] --------------------------------------------------------------------------------
12/04 19:52:39.421 INFO | utils:0287| [stdout] Results saved to /usr/local/autotest/results/lxc_job_folder/tast/results
12/04 19:52:39.421 INFO | utils:0287| [stdout] Lost SSH connection to chromeos6-row2-rack10-host14:22: EOF
12/04 19:52:39.427 DEBUG| test:0381| Test failed due to 1 failed: security.UserFilesLoggedIn; 10 missing: ui.ChromeCrashLoggedIn ui.ChromeCrashNotLoggedIn ui.ChromeLogin ....
tast.DEBUG:
12/04 19:53:07.195 WARNI| test:0606| The test failed with the following exception
Traceback (most recent call last):
File "/usr/local/autotest/client/common_lib/test.py", line 600, in _exec
_call_test_function(self.execute, *p_args, **p_dargs)
File "/usr/local/autotest/client/common_lib/test.py", line 800, in _call_test_function
return func(*args, **dargs)
File "/usr/local/autotest/client/common_lib/test.py", line 464, in execute
postprocess_profiled_run, args, dargs)
File "/usr/local/autotest/client/common_lib/test.py", line 371, in _call_run_once
self.run_once(*args, **dargs)
File "/usr/local/autotest/server/site_tests/tast/tast.py", line 157, in run_once
self._parse_results(run_failed)
File "/usr/local/autotest/server/site_tests/tast/tast.py", line 363, in _parse_results
raise error.TestFail(failure_msg)
TestFail: 1 failed: security.UserFilesLoggedIn; 10 missing: ui.ChromeCrashLoggedIn ui.ChromeCrashNotLoggedIn
log:
https://stainless.corp.google.com/browse/chromeos-autotest-results/263624171-chromeos-test/
,
Dec 5
,
Dec 5
Most likely explanation is that the test kill the DUT. Over to sheriffs to find owner of security.UserFilesLoggedIn.
,
Dec 5
All this test does is log in and check some files on-disk. In this case, the DUT disappeared while the ui job was being restarted: 2018/12/04 19:48:57 Started test security.UserFilesLoggedIn 2018/12/04 19:48:57 [19:48:57.492] Restarting ui job 2018/12/04 19:52:27 Got global error mid-test: timed out after waiting 3m29.998s for next message The messages file indicates that the DUT crashed abruptly (with bogus timestamps in the log?) and then rebooted: ... 2018-12-05T03:43:41.824935+00:00 NOTICE ag[3775]: autotest server[stack::parallel_simple|get_network_stats|run] -> ssh_run(route; echo SEPARATOR; cat /proc/net/dev) 2018-12-05T03:43:42.441776+00:00 NOTICE ag[3781]: autotest server[stack::close|close|run] -> ssh_run(rm -rf "/tmp/autoserv-64ylWH") 2018-12-05T03:43:42.456032+00:00 INFO sshd[3362]: Received disconnect from 100.109.5.6 port 54214:11: disconnected by user 2018-12-05T03:43:42.456193+00:00 INFO sshd[3362]: Disconnected from user root 100.109.5.6 port 54214 �������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������2018-12-04T19:49:04.455356-08:00 INFO kernel: [ 0.000000] Booting Linux on physical CPU 0x0 2018-12-04T19:49:04.455862-08:00 INFO kernel: [ 0.000000] Initializing cgroup subsys cpu 2018-12-04T19:49:04.455871-08:00 NOTICE kernel: [ 0.000000] Linux version 3.8.11 (chrome-bot@swarm-cros-374) (gcc version 4.9.x 20150123 (prerelease) (4.9.2_cos_gg_4.9.2-r197-ac6128e0a17a52f011797f33ac3e7d6273a9368d_4.9.2-r197) ) #1 SMP Tue Dec 4 19:00:29 PST 2018 2018-12-04T19:49:04.455878-08:00 NOTICE kernel: [ 0.000000] CPU: ARMv7 Processor [412fc0f3] revision 3 (ARMv7), cr=10c5387d 2018-12-04T19:49:04.455883-08:00 NOTICE kernel: [ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache 2018-12-04T19:49:04.455888-08:00 INFO kernel: [ 0.000000] Machine: SAMSUNG EXYNOS5 (Flattened Device Tree), model: Google Peach Pit Rev 6+ ... https://storage.cloud.google.com/chromeos-autotest-results/263624171-chromeos-test/chromeos6-row2-rack10-host14/sysinfo/pstore/sys/fs/pstore/console-ramoops contains the following, so maybe it was a kernel crash? [ 505.007615] Unable to handle kernel NULL pointer dereference at virtual address 00000090 [ 505.007647] pgd = c0004000 [ 505.007664] [00000090] *pgd=00000000 [ 505.007692] Internal error: Oops: 5 [#1] SMP ARM [ 505.007710] Modules linked in: i2c_dev cmac rfcomm uinput uvcvideo videobuf2_vmalloc cdc_ether usbnet isl29018(C) btmrvl_sdio btmrvl bluetooth mwifiex_sdio mwifiex rtc_s3c zram(C) zsmalloc(C) fuse cfg80211 nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter snd_seq_midi snd_seq_midi_event snd_rawmidi snd_seq ip6_tables snd_seq_device joydev [ 505.007966] CPU: 0 Tainted: G C (3.8.11 #1) [ 505.008000] PC is at namespace_unlock+0xbc/0x114 [ 505.008025] LR is at lg_global_lock+0x40/0xb0 [ 505.008049] pc : [<c02a9380>] lr : [<c01094c8>] psr: 60000013 [ 505.008049] sp : e8031d48 ip : e7601e40 fp : e8031d7c [ 505.008072] r10: e8031dfc r9 : e8031dfc r8 : 00000000 [ 505.008092] r7 : 00000000 r6 : c0b28b88 r5 : e8031d4c r4 : e85a0900 [ 505.008111] r3 : 00000000 r2 : 00000008 r1 : 00000008 r0 : 00000008 [ 505.008131] Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user [ 505.008152] Control: 10c5387d Table: 48b5006a DAC: 00000015 [ 505.008171] Process TaskSchedulerFo (pid: 5636, stack limit = 0xe8030240) [ 505.008191] Stack: (0xe8031d48 to 0xe8032000) [ 505.008218] 1d40: c02a9e1c e85a0e40 e85a0180 271ae517 e85a0180 e8aa0b00 [ 505.008247] 1d60: 00000000 00000000 e8030020 00000001 e8031d94 e8031d80 c02ab718 c02a92d0 [ 505.008276] 1d80: e8a7ab10 e734e400 e8031dac e8031d98 c01fd060 c02ab6c0 00030003 e8a7ab10 [ 505.008305] 1da0: e8031dcc e8031db0 c01fd2fc c01fd044 00000000 e734e400 e734e630 e8031bc4 [ 505.008334] 1dc0: e8031ddc e8031dd0 c01fd31c c01fd2a4 e8031e34 e8031de0 c01df594 c01fd30c [ 505.008364] 1de0: ffffffff c01ea3d4 e8031e1c e734e3f8 c01ea3d4 e734e678 015b015b e8031dfc [ 505.008393] 1e00: e8031dfc 271ae517 00000009 e7110a00 e8031edc 00000000 e8030000 00404040 [ 505.008423] 1e20: e8030018 e8030000 e8031e54 e8031e38 c01df938 c01deee0 418004fc e8031edc [ 505.008452] 1e40: e8444944 00418004 e8031e9c e8031e58 c01ecd94 c01df8e8 e8031e54 e734e400 [ 505.008481] 1e60: e8031ec8 e7110a00 e8444440 e8030018 00000000 ffffffff afa7c014 e8031fb0 [ 505.008511] 1e80: afa7c016 c01bd6c4 fffffdfc a387ecd8 e8031f8c e8031ea0 c01c0930 c01ec8b4 [ 505.008540] 1ea0: c0106b60 c3b49ac0 00000000 c0b28b88 00000000 6b736154 65686353 656c7564 [ 505.008568] 1ec0: 006f4672 00000000 e734e400 00000075 ffffffff 271ae517 00000000 00000009 [ 505.008596] 1ee0: 00000000 00000000 00000000 00000000 00000080 a387ecd8 e8031fa4 e8031f08 [ 505.008625] 1f00: c011b930 c011aa58 ffffffff 0000000f e8031f64 e8031f20 c0118af8 c056cc7c [ 505.008653] 1f20: d2f565e4 00000000 00000000 00000000 caa388d4 00000084 ef0f4100 a387eb18 [ 505.008681] 1f40: c0b28b88 00000001 caa388d4 00000084 e8030000 00000041 3b9aae2b 271ae517 [ 505.008710] 1f60: c01bd6c4 c01bd6c4 e8030000 e8031fb0 000000f0 c01bd6c4 e8030000 00000000 [ 505.008739] 1f80: e8031fac e8031f90 c01c1068 c01c088c c0b28b88 00000000 a387ecd8 a387ecb0 [ 505.008768] 1fa0: 00000000 e8031fb0 c01bd4e0 c01c1010 a387ecd8 00000080 00000000 a387eb18 [ 505.008796] 1fc0: 00000000 a387ecd8 a387ecb0 000000f0 a387eb20 a387ebb8 a387ecb0 00000000 [ 505.008825] 1fe0: 000000f0 a387ead0 afa76d3b afa7c014 60070030 a387ecd8 f47f4281 e9ddad42 [ 505.008840] Backtrace: [ 505.008881] [<c02a9380>] (namespace_unlock+0xbc/0x114) from [<c02ab718>] (put_mnt_ns+0x64/0x78) [ 505.008919] [<c02ab718>] (put_mnt_ns+0x64/0x78) from [<c01fd060>] (free_nsproxy+0x28/0xc4) [ 505.008954] [<c01fd060>] (free_nsproxy+0x28/0xc4) from [<c01fd2fc>] (switch_task_namespaces+0x64/0x68) [ 505.008989] [<c01fd2fc>] (switch_task_namespaces+0x64/0x68) from [<c01fd31c>] (exit_task_namespaces+0x1c/0x20) [ 505.009026] [<c01fd31c>] (exit_task_namespaces+0x1c/0x20) from [<c01df594>] (do_exit+0x6c0/0x8a8) [ 505.009062] [<c01df594>] (do_exit+0x6c0/0x8a8) from [<c01df938>] (do_group_exit+0x5c/0xc0) [ 505.009102] [<c01df938>] (do_group_exit+0x5c/0xc0) from [<c01ecd94>] (get_signal_to_deliver+0x4ec/0x53c) [ 505.009144] [<c01ecd94>] (get_signal_to_deliver+0x4ec/0x53c) from [<c01c0930>] (do_signal+0xb0/0x49c) [ 505.009181] [<c01c0930>] (do_signal+0xb0/0x49c) from [<c01c1068>] (do_work_pending+0x64/0xac) [ 505.009216] [<c01c1068>] (do_work_pending+0x64/0xac) from [<c01bd4e0>] (work_pending+0xc/0x20) [ 505.009244] Code: e594c010 e594800c e5844008 e584c00c (e5973090) [ 505.009267] ---[ end trace 2d21c2df2264554c ]--- [ 505.011252] Kernel panic - not syncing: Fatal exception [ 505.011294] CPU1: stopping [ 505.011318] Backtrace: [ 505.011367] [<c01c4464>] (unwind_backtrace+0x0/0x110) from [<c06ad54c>] (dump_stack+0x28/0x30) [ 505.011410] [<c06ad54c>] (dump_stack+0x28/0x30) from [<c01c2e58>] (handle_IPI+0xdc/0x158) [ 505.011450] [<c01c2e58>] (handle_IPI+0xdc/0x158) from [<c010040c>] (gic_handle_irq+0x64/0x6c) [ 505.011492] [<c010040c>] (gic_handle_irq+0x64/0x6c) from [<c01bd0c0>] (__irq_svc+0x40/0x50) [ 505.011521] Exception stack(0xef13df00 to 0xef13df48) [ 505.011558] df00: ef13df48 00000075 945dfcb6 00000075 c3b403c0 c019c41c 93d59e8e 00000075 [ 505.011596] df20: 00000000 00000000 c0b7b070 ef13df7c 00000006 ef13df48 c0118c94 c019c740 [ 505.011624] df40: 80000013 ffffffff [ 505.011669] [<c01bd0c0>] (__irq_svc+0x40/0x50) from [<c019c740>] (cpuidle_wrap_enter+0x58/0xa4) [ 505.011709] [<c019c740>] (cpuidle_wrap_enter+0x58/0xa4) from [<c019c450>] (cpuidle_enter_tk+0x14/0x1c) [ 505.011749] [<c019c450>] (cpuidle_enter_tk+0x14/0x1c) from [<c019c5d0>] (cpuidle_idle_call+0x178/0x290) [ 505.011790] [<c019c5d0>] (cpuidle_idle_call+0x178/0x290) from [<c01004bc>] (cpu_idle+0xa4/0x104) [ 505.011839] [<c01004bc>] (cpu_idle+0xa4/0x104) from [<c06aa800>] (secondary_start_kernel+0x10c/0x130) [ 505.011887] [<c06aa800>] (secondary_start_kernel+0x10c/0x130) from [<206a9da8>] (0x206a9da8) [ 505.011915] CPU3: stopping [ 505.011936] Backtrace: [ 505.011975] [<c01c4464>] (unwind_backtrace+0x0/0x110) from [<c06ad54c>] (dump_stack+0x28/0x30) [ 505.012010] [<c06ad54c>] (dump_stack+0x28/0x30) from [<c01c2e58>] (handle_IPI+0xdc/0x158) [ 505.012047] [<c01c2e58>] (handle_IPI+0xdc/0x158) from [<c010040c>] (gic_handle_irq+0x64/0x6c) [ 505.012082] [<c010040c>] (gic_handle_irq+0x64/0x6c) from [<c01bd0c0>] (__irq_svc+0x40/0x50) [ 505.012106] Exception stack(0xef141f00 to 0xef141f48) [ 505.012138] 1f00: ef141f48 00000075 945dfc10 00000075 c3b523c0 c019c41c 9432cffa 00000075 [ 505.012171] 1f20: 00000000 00000000 c0b7b070 ef141f7c 00000006 ef141f48 c0118c94 c019c740 [ 505.012195] 1f40: 80000013 ffffffff [ 505.012229] [<c01bd0c0>] (__irq_svc+0x40/0x50) from [<c019c740>] (cpuidle_wrap_enter+0x58/0xa4) [ 505.012266] [<c019c740>] (cpuidle_wrap_enter+0x58/0xa4) from [<c019c450>] (cpuidle_enter_tk+0x14/0x1c) [ 505.012301] [<c019c450>] (cpuidle_enter_tk+0x14/0x1c) from [<c019c5d0>] (cpuidle_idle_call+0x178/0x290) [ 505.012336] [<c019c5d0>] (cpuidle_idle_call+0x178/0x290) from [<c01004bc>] (cpu_idle+0xa4/0x104) [ 505.012374] [<c01004bc>] (cpu_idle+0xa4/0x104) from [<c06aa800>] (secondary_start_kernel+0x10c/0x130) [ 505.012413] [<c06aa800>] (secondary_start_kernel+0x10c/0x130) from [<206a9da8>] (0x206a9da8) [ 505.012437] CPU2: stopping [ 505.012453] Backtrace: [ 505.012488] [<c01c4464>] (unwind_backtrace+0x0/0x110) from [<c06ad54c>] (dump_stack+0x28/0x30) [ 505.012520] [<c06ad54c>] (dump_stack+0x28/0x30) from [<c01c2e58>] (handle_IPI+0xdc/0x158) [ 505.012552] [<c01c2e58>] (handle_IPI+0xdc/0x158) from [<c010040c>] (gic_handle_irq+0x64/0x6c) [ 505.012584] [<c010040c>] (gic_handle_irq+0x64/0x6c) from [<c01bd0c0>] (__irq_svc+0x40/0x50) [ 505.012604] Exception stack(0xe8fa3e50 to 0xe8fa3e98) [ 505.012627] 3e40: e8fa2000 00000002 00000000 34ad34ad [ 505.012656] 3e60: 0000005f 00001f41 b63ded9a c0be0048 c0b81720 c0be0868 00000021 e8fa3ea4 [ 505.012682] 3e80: ffffffff e8fa3e98 c06b22bc c06b22c0 60000113 ffffffff [ 505.012717] [<c01bd0c0>] (__irq_svc+0x40/0x50) from [<c06b22c0>] (_raw_spin_unlock_irq+0x1c/0x20) [ 505.012753] [<c06b22c0>] (_raw_spin_unlock_irq+0x1c/0x20) from [<c01dca8c>] (do_syslog+0x34c/0x5d0) [ 505.012794] [<c01dca8c>] (do_syslog+0x34c/0x5d0) from [<c02e2080>] (kmsg_read+0x3c/0x64) [ 505.012833] [<c02e2080>] (kmsg_read+0x3c/0x64) from [<c015bd04>] (proc_reg_read+0x90/0xd8) [ 505.012874] [<c015bd04>] (proc_reg_read+0x90/0xd8) from [<c0143990>] (sys_read+0x194/0x270) [ 505.012910] [<c0143990>] (sys_read+0x194/0x270) from [<c01bd4a0>] (ret_fast_syscall+0x0/0x30) [ 505.012955] CPU0 PC: <c01d39a0> exynos5_panic_notify+0x5c/0xbc
,
Dec 10
It seems the same failure has happened. https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?id=3210785
,
Dec 10
#5 is the same kernel segfault as #4. And there's already another bug tracking this. |
|||||
►
Sign in to add a comment |
|||||
Comment 1 by inker@google.com
, Dec 5