New issue
Advanced search Search tips

Issue 911239 link

Starred by 1 user

Issue metadata

Status: WontFix
Merged: issue 911236
Owner:
Closed: Yesterday
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

tast.cryptohome.Login: FAIL: Failed to create a vault for the test user: failed to create vault for cryptohome_test-AT-chromium.org

Project Member Reported by wzang@chromium.org, Dec 3

Issue description

stdout from [1]:

cmd=['/b/swarming/w/ir/cache/cbuild/repository/chromite/third_party/swarming.client/swarming.py', 'run', '--swarming', 'chromeos-proxy.appspot.com', '--task-summary-json', '/b/swarming/w/ir/tmp/t/cbuildbot-tmpNXR124/tmpxQdFl1/temp_summary.json', '--print-status-updates', '--timeout', '14400', '--raw-cmd', '--task-name', u'veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113-chrome-informational', '--dimension', 'os', 'Ubuntu-14.04', '--dimension', 'pool', 'default', '--io-timeout', '14400', '--hard-timeout', '14400', '--expiration', '1200', u'--tags=priority:PFQ', u'--tags=suite:chrome-informational', u'--tags=build:veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113', u'--tags=task_name:veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113-chrome-informational', u'--tags=board:veyron_minnie', '--', '/usr/local/autotest/site_utils/run_suite.py', '--build', u'veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113', '--board', u'veyron_minnie', '--suite_name', u'chrome-informational', '--pool', u'continuous', '--file_bugs', 'True', '--priority', 'PFQ', '--timeout_mins', '180', '--retry', 'False', '--minimum_duts', '1', '--offload_failures_only', 'False', '--job_keyvals', "{'cidb_build_stage_id': 101125990L, 'cidb_build_id': 3186113, 'datastore_parent_key': ('Build', 3186113, 'BuildStage', 101125990L)}", '-m', '263251036']
07:25:29: ERROR: wait_cmd has lab failures: cmd=['/b/swarming/w/ir/cache/cbuild/repository/chromite/third_party/swarming.client/swarming.py', 'run', '--swarming', 'chromeos-proxy.appspot.com', '--task-summary-json', '/b/swarming/w/ir/tmp/t/cbuildbot-tmpNXR124/tmpxQdFl1/temp_summary.json', '--print-status-updates', '--timeout', '14400', '--raw-cmd', '--task-name', u'veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113-chrome-informational', '--dimension', 'os', 'Ubuntu-14.04', '--dimension', 'pool', 'default', '--io-timeout', '14400', '--hard-timeout', '14400', '--expiration', '1200', u'--tags=priority:PFQ', u'--tags=suite:chrome-informational', u'--tags=build:veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113', u'--tags=task_name:veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113-chrome-informational', u'--tags=board:veyron_minnie', '--', '/usr/local/autotest/site_utils/run_suite.py', '--build', u'veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113', '--board', u'veyron_minnie', '--suite_name', u'chrome-informational', '--pool', u'continuous', '--file_bugs', 'True', '--priority', 'PFQ', '--timeout_mins', '180', '--retry', 'False', '--minimum_duts', '1', '--offload_failures_only', 'False', '--job_keyvals', "{'cidb_build_stage_id': 101125990L, 'cidb_build_id': 3186113, 'datastore_parent_key': ('Build', 3186113, 'BuildStage', 101125990L)}", '-m', '263251036'].
Exception will be raised in the next json_dump run.
Autotest instance created: cautotest-prod
12-03-2018 [06:55:42] Created suite job: http://cautotest-prod/afe/#tab_id=view_job&object_id=263251036
12-03-2018 [07:24:53] Suite job is finished.
12-03-2018 [07:24:53] Start collecting test results and dump them to json.
Suite job                               [ PASSED ]
tast                                    [ PASSED ]
tast.cryptohome.Login                   [ FAILED ]
tast.cryptohome.Login                     FAIL: Failed to create a vault for the test user: failed to create vault for cryptohome_test@chromium.org: context deadline exceeded; last error follows: context deadline exceeded
tast.cryptohome.LoginGuest              [ PASSED ]
tast.graphics.ScreenshotCLI             [ PASSED ]
tast.graphics.ScreenshotChrome          [ PASSED ]
tast.platform.Histograms                [ PASSED ]
tast.platform.MLServiceBootstrap        [ PASSED ]
tast.security.GPUSandboxed              [ PASSED ]
tast.security.OpenFDs                   [ PASSED ]
tast.security.Sandboxed                 [ PASSED ]
tast.session.LogoutCleanup              [ PASSED ]
tast.ui.Exceptions                      [ PASSED ]
tast.ui.SupervisedUserCrash             [ PASSED ]
tast.ui.VirtualKeyboardOmnibox          [ PASSED ]
tast.ui.VirtualKeyboardTyping           [ PASSED ]
tast.video.PlayDecodeAccelUsedH264      [ PASSED ]
tast.video.PlayDecodeAccelUsedMSEH264   [ PASSED ]
tast.video.PlayDecodeAccelUsedMSEVP8    [ PASSED ]
tast.video.PlayDecodeAccelUsedVP8       [ PASSED ]
tast.video.PlayH264                     [ PASSED ]
tast.video.PlayVP8                      [ PASSED ]
tast.video.PlayVP9                      [ PASSED ]
tast                                    [ PASSED ]
tast.arc.Downloads                      [ PASSED ]
tast.arc.IntentForward                  [ PASSED ]
tast.arc.SettingsBridge                 [ PASSED ]
tast.arcapp.Sample                      [ PASSED ]
tast.security.NetworkListenersARC       [ PASSED ]
tast.security.SELinuxFilesARC           [ PASSED ]
tast.ui.SupervisedUserCrashARC          [ PASSED ]
desktopui_MashLogin                     [ PASSED ]
desktopui_SingleProcessMashLogin        [ PASSED ]

Suite timings:
Downloads started at 2018-12-03 06:55:36
Payload downloads ended at 2018-12-03 06:55:38
Suite started at 2018-12-03 06:59:43
Artifact downloads ended (at latest) at 2018-12-03 06:59:48
Testing started at 2018-12-03 07:03:56
Testing ended at 2018-12-03 07:22:42


Links to test logs:
Suite job http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251036-chromeos-test/
tast http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.cryptohome.Login http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.cryptohome.LoginGuest http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.graphics.ScreenshotCLI http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.graphics.ScreenshotChrome http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.platform.Histograms http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.platform.MLServiceBootstrap http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.security.GPUSandboxed http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.security.OpenFDs http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.security.Sandboxed http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.session.LogoutCleanup http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.ui.Exceptions http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.ui.SupervisedUserCrash http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.ui.VirtualKeyboardOmnibox http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.ui.VirtualKeyboardTyping http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.video.PlayDecodeAccelUsedH264 http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.video.PlayDecodeAccelUsedMSEH264 http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.video.PlayDecodeAccelUsedMSEVP8 http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.video.PlayDecodeAccelUsedVP8 http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.video.PlayH264 http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.video.PlayVP8 http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast.video.PlayVP9 http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251065-chromeos-test/
tast http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251067-chromeos-test/
tast.arc.Downloads http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251067-chromeos-test/
tast.arc.IntentForward http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251067-chromeos-test/
tast.arc.SettingsBridge http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251067-chromeos-test/
tast.arcapp.Sample http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251067-chromeos-test/
tast.security.NetworkListenersARC http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251067-chromeos-test/
tast.security.SELinuxFilesARC http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251067-chromeos-test/
tast.ui.SupervisedUserCrashARC http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251067-chromeos-test/
desktopui_MashLogin http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251070-chromeos-test/
desktopui_SingleProcessMashLogin http://cautotest-prod/tko/retrieve_logs.cgi?job=/results/263251076-chromeos-test/


12-03-2018 [07:25:05] Gathering timing stats for the suite job.

 12-03-2018 [07:25:05] Attempting to display pool info: continuous
host: chromeos4-row9-rack9-host17, status: Running, locked: False diagnosis: Working
labels: ['bluetooth', 'ec:cros', 'gpu_family:mali', 'graphics:gles', 'veyron_minnie', 'board_freq_mem:veyron_minnie_1.8GHz_4GB', 'audio_loopback_dongle', 'accel:cros-ec', 'board:veyron_minnie', 'os:cros', 'servo', 'model:veyron_minnie', 'arc', 'hw_video_acc_enc_vp8', 'power:battery', '4k_video_h264', '4k_video_vp8', 'hw_video_acc_vp8', 'hw_video_acc_h264', 'storage:mmc', 'webcam', 'touchpad', 'touchscreen', 'phase:PVT', 'pool:continuous', 'sparse_coverage_5', 'sparse_coverage_3', 'sparse_coverage_2', 'variant:minnie', 'cts_abi_arm', 'internal_display', 'cts_cpu_arm', 'cros-version:veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113', 'sku:minnie_rk3288_4Gb']
Last 10 jobs within 3:18:00:
2872328 Reset started on: 2018-12-03 07:20:29 status PASS
264150638 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/bvt-cq/video_ChromeHWDecodeUsed.h264 started on: 2018-12-03 07:18:20 status Completed
2872315 Reset started on: 2018-12-03 07:17:42 status PASS
264150631 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/chrome-informational/tast.informational started on: 2018-12-03 07:10:32 status Completed
2872263 Reset started on: 2018-12-03 07:09:51 status PASS
264150630 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/bvt-cq/platform_ToolchainOptions started on: 2018-12-03 07:02:43 status Completed
2872219 Reset started on: 2018-12-03 07:02:00 status PASS
264146754 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/provision/dummy_Pass started on: 2018-12-03 06:52:16 status Completed
2872136 Provision started on: 2018-12-03 06:44:02 status PASS

host: chromeos4-row9-rack10-host7, status: Resetting, locked: False diagnosis: Working
labels: ['bluetooth', 'ec:cros', 'veyron_minnie', 'accel:cros-ec', 'internal_display', 'os:cros', 'power:battery', 'board:veyron_minnie', 'usb_nic:smsc75xx', 'pool:continuous', 'touchpad', 'touchscreen', 'phase:PVT', 'model:veyron_minnie', 'sparse_coverage_5', 'sparse_coverage_3', 'sparse_coverage_2', 'arc', 'hw_video_acc_enc_vp8', 'storage:mmc', '4k_video_h264', '4k_video_vp8', 'hw_video_acc_vp8', 'hw_video_acc_h264', 'webcam', 'cts_abi_arm', 'servo', 'variant:minnie', 'cts_cpu_arm', 'cros-version:veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113', 'sku:minnie_rk3288_4Gb']
Last 10 jobs within 3:18:00:
2872343 Reset started on: 2018-12-03 07:23:14 status PASS
264150640 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/chrome-informational/desktopui_SingleProcessMashLogin started on: 2018-12-03 07:21:26 status Completed
2872329 Reset started on: 2018-12-03 07:20:47 status PASS
264150636 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/bvt-inline/platform_DMVerityBitCorruption started on: 2018-12-03 07:18:00 status Completed
2872312 Reset started on: 2018-12-03 07:17:24 status PASS
264150634 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/chrome-informational/desktopui_MashLogin started on: 2018-12-03 07:15:25 status Completed
2872296 Reset started on: 2018-12-03 07:14:48 status PASS
264150632 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/bvt-cq/audio_Microphone started on: 2018-12-03 07:13:17 status Completed
2872280 Reset started on: 2018-12-03 07:12:36 status PASS
264150629 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/chrome-informational/tast.informational started on: 2018-12-03 07:02:44 status Completed

host: chromeos4-row9-rack10-host9, status: Running, locked: False diagnosis: Working
labels: ['ec:cros', 'veyron_minnie', 'hw_video_acc_vp8', 'hw_video_acc_enc_vp8', 'cts_abi_arm', 'os:cros', 'power:battery', 'hw_video_acc_h264', 'storage:mmc', 'webcam', 'board:veyron_minnie', 'usb_nic:smsc75xx', 'pool:continuous', '4k_video_h264', '4k_video_vp8', 'model:veyron_minnie', 'internal_display', 'sparse_coverage_5', 'sparse_coverage_3', 'sparse_coverage_2', 'arc', 'touchpad', 'touchscreen', 'phase:PVT', 'audio_loopback_dongle', 'bluetooth', 'accel:cros-ec', 'servo', 'variant:minnie', 'cts_cpu_arm', 'cros-version:veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113', 'sku:minnie_rk3288_4Gb']
Last 10 jobs within 3:18:00:
2872310 Reset started on: 2018-12-03 07:16:57 status PASS
264150633 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/bvt-tast-chrome-pfq/tast.mustpass-android started on: 2018-12-03 07:13:33 status Completed
2872282 Reset started on: 2018-12-03 07:12:54 status PASS
264150628 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/bvt-cq/cheets_StartAndroid.stress.0 started on: 2018-12-03 07:02:42 status Completed
2872217 Reset started on: 2018-12-03 07:02:00 status PASS
264146753 veyron_minnie-tot-chrome-pfq-informational/R73-11335.0.0-b3186113/provision/dummy_Pass started on: 2018-12-03 06:52:20 status Completed
2872135 Provision started on: 2018-12-03 06:44:02 status PASS

Reason: Tests failed.

 12-03-2018 [07:25:13] Output below this line is for buildbot consumption:
Will return from run_suite with status: ERROR


[1] https://luci-logdog.appspot.com/logs/chromeos/buildbucket/cr-buildbucket.appspot.com/8928159725206564352/+/steps/HWTest__chrome-informational_/0/stdout

[2] build failure:

https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8928159725206564352


derat@, could you help to triage since this is a Tast failure? Thanks!
 
Labels: OS-Chrome
Cc: jamescook@chromium.org steve...@chromium.org apronin@chromium.org
Owner: hidehiko@chromium.org
Thanks for filing the bug!

This is an informational test, which we generally don't pay a lot of attention to. We *do* run informational Chrome tests in the chrome-informational suite on ToT PFQ builders ( issue 887575 ), although test failures here were downgraded to just be warnings ( issue 895044 ). The build that you linked to failed because of the cheets_ContainerMount Autotest test failing in bvt-arc, not because of the cryptohome.Login failure in chrome-informational.

I think that the main motivation for running informational tests here was to make it easier to see if Mash-related tests were passing with ToT Chrome. I believe that these tests are now typically running in the bvt-tast-cq suite (and also running in the Chrome CQ now), though.

James, is there still value in having the chrome-informational suite?

In any case, reassigning the bug to hidehiko@ in case he has thoughts about the failure. The logs are at http://stainless/browse/chromeos-autotest-results/263251065-chromeos-test/ .

2018/12/03 07:04:53 Started test cryptohome.Login
2018/12/03 07:04:53 [07:04:53.932] Creating vault mount for user "cryptohome_test@chromium.org"
2018/12/03 07:04:59 [07:04:59.934] External command timed out
2018/12/03 07:04:59 [07:04:59.934] Command: cryptohome --action=mount_ex --user=cryptohome_test@chromium.org --password=testme --async --create --key_label=bar
2018/12/03 07:04:59 [07:04:59.935] Uncaptured output:
2018/12/03 07:04:59 [07:04:59.936] Error at login.go:37: Failed to create a vault for the test user: failed to create vault for cryptohome_test@chromium.org: context deadline exceeded; last error follows: context deadline exceeded

There's some possibly-relevant info in the messages file. Maybe the test needs a longer timeout for creating the vault?
Mergedinto: 911236
Status: Duplicate (was: Untriaged)
Thanks derat@, then it should be merged to  crbug.com/911236  which tracks the cheets_ContainerMount failure.
Status: Assigned (was: Duplicate)
The cryptohome.Login failure is still worth fixing since the plan is to move it to the CQ (to replace login_Cryptohome, I think). Let's use this bug to track that.
Dan, I use the chrome-informational autotests to ensure the mash build sheriff gets an email as soon as a mash login test fails. If there's some way to do that with Tast, I'm happy to eliminate chrome-informational.

Got it. Sounds like we should keep chrome-informational, then.
Oh, I'd love to get rid of chrome-information, I just need some way to get prompt notification of failures. :-)

Comment 8 by hidehiko@chromium.org, Yesterday (41 hours ago)

Status: WontFix (was: Assigned)
Marking won't fix.
This failure is no longer observed in recent runs.
If we need to check M72 release builders, please feel free to reopen.

Sign in to add a comment