New issue
Advanced search Search tips

Issue 669288 link

Starred by 1 user

Issue metadata

Status: Verified
Owner: ----
Closed: Nov 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

WebKit Win - RandomOrder has consistent 'Failed to load private key JSON' infra error

Project Member Reported by jeffcarp@chromium.org, Nov 29 2016

Issue description

Sample:
[P1132 15:48:30.726 service.go:71 W] Failed to load private key JSON - open C:\creds\service_accounts\service-account-goma-client.json: The system cannot find the file specified. {"pkg":"auth"}
[P1132 15:48:30.726 auth.go:580 W] Failed to mint a token: invalid service account credentials {"pkg":"auth"}
[P1132 15:48:30.726 remote.go:95 W] cipd: connectivity error (Get https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Fwindows-amd64&version=goma_recipe_module: invalid service account credentials)
[P1132 15:48:30.726 remote.go:95 W] cipd: retrying request to https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Fwindows-amd64&version=goma_recipe_module

Full error output:
https://build.chromium.org/p/chromium.fyi/builders/WebKit%20Win%20-%20RandomOrder/builds/25/steps/ensure_goma.ensure_installed/logs/stdio

Recent builds:
https://luci-milo.appspot.com/buildbot/chromium.fyi/WebKit%20Win%20-%20RandomOrder/?limit=200
 

Comment 1 by s...@google.com, Nov 29 2016

Cc: jeffcarp@chromium.org
Components: -Infra Infra>Labs
Owner: ----
Should chromium.fyi builders have the goma-client service account installed by Puppet or is there another service account we should use?
Cc: dpranke@chromium.org
I'm not sure, adding dpranke who might know.
Summary: WebKit Win - RandomOrder has consistent 'Failed to load private key JSON' infra error (was: WebKit Mac - RandomOrder has consistent 'Failed to load private key JSON' infra error)
I thought this was installed via puppet, but labs would know better than I.
This should have installed it: https://chrome-internal.googlesource.com/infra/puppet/+/master/puppetm/opt/puppet/conf/nodes.yaml#382

Please always post the bot name (vm111-m1).

I'll re-run puppet.  Hint: on windows you type: "schtasks /run /tn puppet" to do that.  then you can follow logs at /cygdrive/{c,e}/chrome-infra-logs/run_puppet.2016-11-29.log

Looks like puppet isn't happy on this host.
Host was really messed up.  Couldnt even close the run_slave.bat window.  Rebooted it.  Ran puppet...

$ ls -l /cygdrive/c/creds/service_accounts/service-account-goma-client.json
-rwxrwx---+ 1 Administrators Users 2335 Nov 29 16:58 /cygdrive/c/creds/service_accounts/service-account-goma-client.json

Should get passed that part now at least.
Status: Verified (was: Untriaged)
Looks like it took an hour or so to pick up a build, but is running now (and past that failure). 

We can open a new bug if we hit other issues. Thanks!

Sign in to add a comment