New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 804442 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Last visit > 30 days ago
Closed: Jan 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug

Blocked on:
issue 804632
issue 804675
issue 804875



Sign in to add a comment

Provision chromeos-server-tester{1,2}

Project Member Reported by nxia@chromium.org, Jan 22 2018

Issue description

Project Member

Comment 1 by bugdroid1@chromium.org, Jan 22 2018

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/chromeos/chromeos-admin/+/d3036f72cad268187b8a69d56dfe3c38d503ea9f

commit d3036f72cad268187b8a69d56dfe3c38d503ea9f
Author: Ningning Xia <nxia@chromium.org>
Date: Mon Jan 22 20:43:42 2018

Comment 2 by nxia@chromium.org, Jan 22 2018

provision failed with 

Reading package lists... Done
E: Could not get lock /var/lib/apt/lists/lock - open (11: Resource temporarily unavailable)
E: Unable to lock directory /var/lib/apt/lists/


I manually removed
/var/lib/apt/lists/lock
/var/lib/dpkg/lock

Comment 3 by nxia@chromium.org, Jan 22 2018

Cc: pprabhu@chromium.org
provision failed with 

ValueError: '/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/../../puppet/keys/private_key.pkcs7.pem' is not a valid local path or glob.

2018-01-22 13:18:11,114 ERRO| '/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/../../puppet/keys/private_key.pkcs7.pem' is not a valid local path or glob.
2018-01-22 13:18:11,114 INFO| Printing out task report.
{
  "sub_reports": [],
  "exception": "ValueError(\"'/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/../../puppet/keys/private_key.pkcs7.pem' is not a valid local path or glob.\",)",
  "is_successful": false,
  "description": "'/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/../../puppet/keys/private_key.pkcs7.pem' is not a valid local path or glob.",
  "arguments_used": {
    "host_server": "chromeos-server-tester1.mtv.corp.google.com"
  },
  "task_name": "ShardProvisionTask"
}

I checked my workstation, it only has public_key.pkcs7.pem

nxia@nxia:~/chromiumos/chromeos-admin/puppet/keys$ ls
public_key.pkcs7.pem

pprabhu@, did I miss any steps ?




FYI, #2 is also a KI: issue 796735

Comment 6 by nxia@chromium.org, Jan 23 2018

The provision was stuck at deploy_puppet, going to reboot the server and re-run the provision


[chromeos-server-tester1.mtv.corp.google.com] out: Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/interfaces/run_server_task.py", line 100, in <module>
    sys.exit(main())
  File "/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/interfaces/run_server_task.py", line 93, in main
    report = task_class(**task_arg_dict).run()
  File "/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/tasks/task.py", line 66, in run
    self._run()
  File "/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/tasks/atomic_shard.py", line 73, in _run
    self._deploy_puppet()
  File "/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/tasks/atomic_common.py", line 94, in decorated_func
    return func(self)
  File "/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/tasks/atomic_common.py", line 167, in _deploy_puppet
    fabfile.deploy_puppet(server_type=self.server_type)
  File "/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/fabfile.py", line 166, in deploy_puppet
    _run_puppet(server_type=server_type)
  File "/usr/local/google/home/nxia/chromiumos/chromeos-admin/venv/server_management_lib/fabfile.py", line 194, in _run_puppet
    sudo('HOME=/root/ FACTER_server_type="%s" %s' % (server_type, puppet_cmd))


Comment 7 by nxia@chromium.org, Jan 23 2018

Failed with the following output. I run 'sudo dpkg --configure -a', after which I can't switch to sudo with my password. 

[chromeos-server-tester1.mtv.corp.google.com] sudo: apt-get install virt-what --yes
[chromeos-server-tester1.mtv.corp.google.com] out: E: dpkg was interrupted, you must manually run 'sudo dpkg --configure -a' to correct the problem. 
[chromeos-server-tester1.mtv.corp.google.com] out: 


Fatal error: sudo() received nonzero return code 100 while executing!

Requested: apt-get install virt-what --yes
Executed: sudo -S -p 'sudo password:'  /bin/bash -l -c "apt-get install virt-what --yes"

Comment 8 by nxia@chromium.org, Jan 23 2018

Blockedon: 804632

Comment 9 by ihf@chromium.org, Jan 23 2018

Cc: ihf@chromium.org

Comment 10 by nxia@chromium.org, Jan 30 2018

Blockedon: 804875

Comment 11 by nxia@chromium.org, Jan 30 2018

Blockedon: 804675

Comment 12 by nxia@chromium.org, Jan 30 2018

Status: Fixed (was: Untriaged)

Sign in to add a comment