Issue 666451 link

Starred by 1 user

Issue metadata

Status:	Archived
Owner:	pprabhu@chromium.org
Closed:	Dec 2016
Components:	Infra>Client>ChromeOS
EstimatedDays:	----
NextAction:	----
OS:	Chrome
Pri:	2
Type:	Bug
VerifyIn-58 VerifyIn-59 VerifyIn-60 VerifyIn-61

DevserverProvisionTask: Verification following provision uses bad cros revision

Project Member Reported by pprabhu@chromium.org, Nov 17 2016

Issue description

The verification after DevserverProvisionTask always fails:

[chromeos2-devserver5.cros.corp.google.com] run: curl "http://localhost:8082/stage?artifacts=full_payload,stateful,autotest_packages&files=&archive_url=gs://chromeos-image-archive/daisy-release/R56-8999.0.0/"
[chromeos2-devserver5.cros.corp.google.com] out: <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
[chromeos2-devserver5.cros.corp.google.com] out: "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
[chromeos2-devserver5.cros.corp.google.com] out: <html>
[chromeos2-devserver5.cros.corp.google.com] out: <head>
[chromeos2-devserver5.cros.corp.google.com] out:     <meta http-equiv="Content-Type" content="text/html; charset=utf-8"></meta>
[chromeos2-devserver5.cros.corp.google.com] out:     <title>500 Internal Server Error</title>
[chromeos2-devserver5.cros.corp.google.com] out:     <style type="text/css">
[chromeos2-devserver5.cros.corp.google.com] out:     #powered_by {
[chromeos2-devserver5.cros.corp.google.com] out:         margin-top: 20px;
[chromeos2-devserver5.cros.corp.google.com] out:         border-top: 2px solid black;
[chromeos2-devserver5.cros.corp.google.com] out:         font-style: italic;
[chromeos2-devserver5.cros.corp.google.com] out:     }
[chromeos2-devserver5.cros.corp.google.com] out: 
[chromeos2-devserver5.cros.corp.google.com] out:     #traceback {
[chromeos2-devserver5.cros.corp.google.com] out:         color: red;
[chromeos2-devserver5.cros.corp.google.com] out:     }
[chromeos2-devserver5.cros.corp.google.com] out:     </style>
[chromeos2-devserver5.cros.corp.google.com] out: </head>
[chromeos2-devserver5.cros.corp.google.com] out:     <body>
[chromeos2-devserver5.cros.corp.google.com] out:         <h2>500 Internal Server Error</h2>
[chromeos2-devserver5.cros.corp.google.com] out:         <p>The server encountered an unexpected condition which prevented it from fulfilling the request.</p>
[chromeos2-devserver5.cros.corp.google.com] out:         <pre id="traceback">Traceback (most recent call last):
[chromeos2-devserver5.cros.corp.google.com] out:   File "/usr/lib/python2.7/dist-packages/cherrypy/_cprequest.py", line 656, in respond
[chromeos2-devserver5.cros.corp.google.com] out:     response.body = self.handler()
[chromeos2-devserver5.cros.corp.google.com] out:   File "/usr/lib/python2.7/dist-packages/cherrypy/lib/encoding.py", line 188, in __call__
[chromeos2-devserver5.cros.corp.google.com] out:     self.body = self.oldhandler(*args, **kwargs)
[chromeos2-devserver5.cros.corp.google.com] out:   File "/usr/lib/python2.7/dist-packages/cherrypy/_cpdispatch.py", line 34, in __call__
[chromeos2-devserver5.cros.corp.google.com] out:     return self.callable(*self.args, **self.kwargs)
[chromeos2-devserver5.cros.corp.google.com] out:   File "/home/chromeos-test/chromiumos/src/platform/dev/devserver.py", line 791, in stage
[chromeos2-devserver5.cros.corp.google.com] out:     dl.Download(factory, async=async)
[chromeos2-devserver5.cros.corp.google.com] out:   File "/home/chromeos-test/chromiumos/src/platform/dev/downloader.py", line 190, in Download
[chromeos2-devserver5.cros.corp.google.com] out:     self._DownloadArtifactsSerially(required_artifacts, no_wait=True)
[chromeos2-devserver5.cros.corp.google.com] out:   File "/home/chromeos-test/chromiumos/src/platform/dev/downloader.py", line 231, in _DownloadArtifactsSerially
[chromeos2-devserver5.cros.corp.google.com] out:     artifact.Process(self, no_wait)
[chromeos2-devserver5.cros.corp.google.com] out:   File "/home/chromeos-test/chromiumos/src/platform/dev/build_artifact.py", line 334, in Process
[chromeos2-devserver5.cros.corp.google.com] out:     self.name, self.is_regex_name, timeout)
[chromeos2-devserver5.cros.corp.google.com] out:   File "/home/chromeos-test/chromiumos/src/platform/dev/downloader.py", line 327, in Wait
[chromeos2-devserver5.cros.corp.google.com] out:     (name, self._archive_url))
[chromeos2-devserver5.cros.corp.google.com] out: ArtifactDownloadError: Could not find *_full_* in Google Storage at gs://chromeos-image-archive/daisy-release/R56-8999.0.0
[chromeos2-devserver5.cros.corp.google.com] out: </pre>
[chromeos2-devserver5.cros.corp.google.com] out:     <div id="powered_by">
[chromeos2-devserver5.cros.corp.google.com] out:     <span>Powered by <a href="http://www.cherrypy.org">CherryPy 3.2.2</a></span>
[chromeos2-devserver5.cros.corp.google.com] out:     </div>
[chromeos2-devserver5.cros.corp.google.com] out:     </body>
[chromeos2-devserver5.cros.corp.google.com] out: </html>
[chromeos2-devserver5.cros.corp.google.com] out:

Comment 1 by pprabhu@chromium.org, Nov 17 2016

Status: Available (was: Untriaged)

Changing the revision to one earlier than that one works on the newly minted devserver:


chromeos-test@chromeos2-devserver5:~$ curl "http://localhost:8082/stage?artifacts=full_payload,stateful,autotest_packages&files=&archive_url=gs://chromeos-image-archive/daisy-release/R56-8998.0.0/"


The problem is that we list the latest available images in the archive and pick the latest. The latest may not have been uploaded completely. It's better to use at least the second last:

From: chromeos-admin/server_management_lib/tasks/atomic_devserver.py

    # Verify whether can get both cros and android image.
    gs_cmd = 'gsutil ls gs://chromeos-image-archive/daisy-release/ | tail -1'
    image = api.run(gs_cmd).strip()

Comment 2 by pprabhu@chromium.org, Nov 22 2016

Owner: pprabhu@chromium.org
Status: Started (was: Available)

Comment 3 by autumn@chromium.org, Nov 29 2016

Labels: -current-issue

Project Member

Comment 4 by bugdroid1@chromium.org, Dec 6 2016

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/chromeos/chromeos-admin/+/cb24328e6e91cf2a31ba9a22b4e5938a9f2a55d8

commit cb24328e6e91cf2a31ba9a22b4e5938a9f2a55d8
Author: Prathmesh Prabhu <pprabhu@chromium.org>
Date: Tue Nov 22 22:19:40 2016