New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 915509 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Dec 18
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug-Regression



Sign in to add a comment

betty-arcnext-pre-cq VMTest stage failing due to Android not starting in login_VMSanity and cheets_ContainerSmokeTest_P

Project Member Reported by derat@chromium.org, Dec 16

Issue description

betty-arcnext-pre-cq has been failing frequently lately in VMTest, with failures in login_VMSanity and cheets_ContainerSmokeTest_P: http://cros-goldeneye/chromeos/legoland/builderHistory?buildConfig=betty-arcnext-pre-cq&buildBranch=master

betty-pre-cq is fine, so the problem is presumably in the new ARC code: http://cros-goldeneye/chromeos/legoland/builderHistory?buildConfig=betty-pre-cq&buildBranch=master

Looking back a few days, the first failure I see is http://cros-goldeneye/chromeos/healthmonitoring/buildDetails?buildbucketId=8927174359096538784, started at 2018-12-14 01:44.

Here are some not very helpful errors:

12/14 06:06:26.106 ERROR|             utils:0287| [stderr] core/adb/adb_auth_host.c::generate_key():generate_key '/tmp/adb_keys/test_key'
12/14 06:06:26.430 ERROR|             utils:0287| [stderr] core/adb/adb_auth_host.c::write_public_keyfile():Writing public key to '/tmp/adb_keys/test_key.pub'
12/14 06:07:20.036 ERROR|             utils:2770| Timed out waiting for condition: Android container still running after Chrome shutdown.
12/14 06:07:23.026 ERROR|          parallel:0026| child process failed

...
12/14 06:11:07.221 INFO |        arc_common:0091| Waiting for Android to boot completely.
12/14 06:11:17.671 INFO |        arc_common:0107| Android has booted completely.
12/14 06:11:17.674 INFO |               arc:0837| Starting ARC setup
12/14 06:11:17.913 WARNI|              test:0606| The test failed with the following exception
Traceback (most recent call last):
  File "/usr/local/autotest/common_lib/test.py", line 567, in _exec
    _cherry_pick_call(self.initialize, *args, **dargs)
  File "/usr/local/autotest/common_lib/test.py", line 715, in _cherry_pick_call
    return func(*p_args, **p_dargs)
  File "/usr/local/autotest/common_lib/cros/arc.py", line 741, in initialize
    raise error.TestFail(err)
TestFail: Command <adb shell 'settings put global verifier_verify_adb_installs 0'> failed, rc=255, Command returned non-zero exit status
* Command: 
    adb shell 'settings put global verifier_verify_adb_installs 0'

It looks like it's failing more than half the time now, so I'm going to mark the builder experimental.
 
Cc: edcourtney@chromium.org
b/121001699 is also discussing about
"Timed out waiting for condition: Android container still running after Chrome shutdown."


b/121102309 may also be related (for the latter half), which can randomly kill any adb connection.
Cc: bmgordon@chromium.org
Cc: hugobenichi@chromium.org
Status: Fixed (was: Assigned)
https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8926851188415866944 (started at 2018-12-17 15:21, with 11420.0.0) is the last login_VMSanity failure, and that version was without the fix by Hugo at b/121102309 .

Hugo's fix was included in 11421.0.0 and we haven't seen the failure since then. I'd close this for now. Please reopen if we see this again.

Sign in to add a comment