New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 785606 link

Starred by 2 users

Issue metadata

Status: Fixed
Owner:
Last visit > 30 days ago
Closed: Nov 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 0
Type: Bug



Sign in to add a comment

Tryjob submission is broken (in gob_util) from workstation

Project Member Reported by dgarr...@chromium.org, Nov 16 2017

Issue description

cros tryjob --swarming -g 773628 lumpy-compile-only-pre-cq

Verifying patches...
17:43:08: ERROR: cros tryjob failed before completing.
17:43:08: ERROR: <class 'httplib2.ServerNotFoundError'>: Unable to find the server at metadata.google.internal
Traceback (most recent call last):
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/parallel.py", line 603, in TaskRunner
    task(*x, **task_kwargs)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/parallel.py", line 801, in <lambda>
    fn = lambda idx, task_args: out_queue.put((idx, task(*task_args)))
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/gerrit.py", line 317, in <lambda>
    lambda c: self.GetChangeDetail(c, verbose=verbose),
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/gerrit.py", line 130, in GetChangeDetail
    self.host, change_num, o_params=o_params)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/gob_util.py", line 428, in GetChangeDetail
    return FetchUrlJson(host, path)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/gob_util.py", line 309, in FetchUrlJson
    fh = FetchUrl(*args, **kwargs)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/gob_util.py", line 301, in FetchUrl
    _FetchUrlHelper, sleep=SLEEP)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/retry_util.py", line 272, in RetryException
    return _run()
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/retry_util.py", line 177, in _Wrapper
    ret = func(*args, **kwargs)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/retry_util.py", line 271, in _run
    return functor(*args, **kwargs)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/timeout_util.py", line 191, in TimeoutWrapper
    return func(*args, **kwargs)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/gob_util.py", line 229, in _FetchUrlHelper
    body=body)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/lib/gob_util.py", line 159, in CreateHttpConn
    headers['Authorization'] = 'Bearer %s' % credentials.get_access_token()
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/third_party/oauth2client/client.py", line 754, in get_access_token
    self.refresh(http)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/third_party/oauth2client/client.py", line 633, in refresh
    self._refresh(http.request)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/third_party/oauth2client/gce.py", line 87, in _refresh
    response, content = http_request(uri)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/third_party/httplib2/__init__.py", line 1593, in request
    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/third_party/httplib2/__init__.py", line 1335, in _request
    (response, content) = self._conn_request(conn, request_uri, method, body, headers)
  File "/usr/local/google/home/dgarrett/sand/clean/chromite/third_party/httplib2/__init__.py", line 1263, in _conn_request
    raise ServerNotFoundError("Unable to find the server at %s" % conn.host)
ServerNotFoundError: Unable to find the server at metadata.google.internal

 
Cc: nxia@chromium.org
jkip@ confirmed, it seems that nobody who sync's to TOT will be able to schedule tryjobs.

This may also apply to the PreCQ launcher after it's next restart.
Cc: wonderfly@chromium.org
Cc: -wonderfly@chromium.org wonderfly@google.com

Comment 4 by pho...@chromium.org, Nov 16 2017

Status: Fixed (was: Untriaged)
Fixed for now with a revert.

Comment 5 by pho...@chromium.org, Nov 16 2017

Issue 785371 has been merged into this issue.

Sign in to add a comment