New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 890098 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
OOO
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

gs cache failed to start due to gsutil cache error

Project Member Reported by gu...@chromium.org, Sep 28

Issue description

Thu Sep 27 17:38:14 PDT 2018 gs_archive_server socket:/run/gs_archive_server/socket1: starting.
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/usr/local/google/home/chromeos-test/chromiumos/src/platform/dev/gs_cache/gs_archive_server.py", line 645, in <module>
    sys.exit(main(sys.argv[1:]))
  File "/usr/local/google/home/chromeos-test/chromiumos/src/platform/dev/gs_cache/gs_archive_server.py", line 641, in main
    cherrypy.quickstart(GsArchiveServer(_CachingServer(args.caching_server)))
  File "/usr/local/google/home/chromeos-test/chromiumos/src/platform/dev/gs_cache/gs_archive_server.py", line 266, in __init__
    self._gsutil = gs.GSContext()
  File "/usr/local/google/home/chromeos-test/chromiumos/src/platform/dev/gs_cache/chromite/lib/gs.py", line 530, in __init__
    gsutil_bin = self.GetDefaultGSUtilBin(cache_dir, cache_user=cache_user)
  File "/usr/local/google/home/chromeos-test/chromiumos/src/platform/dev/gs_cache/chromite/lib/gs.py", line 424, in GetDefaultGSUtilBin 
    cls._CompileCrcmod(ref.path)
  File "/usr/local/google/home/chromeos-test/chromiumos/src/platform/dev/gs_cache/chromite/lib/gs.py", line 456, in _CompileCrcmod
    osutils.Touch(flag)
  File "/usr/local/google/home/chromeos-test/chromiumos/src/platform/dev/gs_cache/chromite/lib/osutils.py", line 171, in Touch
    open(path, 'a').close()
IOError: [Errno 2] No such file or directory: '/tmp/chromeos-cache/common/gsutil_4.33.tar.gz/gsutil/third_party/crcmod/.chromite.tried.build'
Thu Sep 27 17:38:16 PDT 2018 gs_archive_server socket:/run/gs_archive_server/socket1: exited.

 
Cc: vapier@chromium.org
Hi Mike,

Do you have any idea why we have this issue? The code of chromite should be up to date.

chromeos-test@chromeos-gt-devserver17:~/chromiumos/src/platform/dev/gs_cache/chromite$ git remote -v
cros    https://chromium.googlesource.com/chromiumos/chromite (fetch)
cros    https://chromium.googlesource.com/chromiumos/chromite (push)
chromeos-test@chromeos-gt-chromeos-test@chromeos-gt-devserver17:~/chromiumos/src/platform/dev/gs_cache/chromite$ git log -1 --oneline
57988b451 (HEAD) dev_server_wrapper.py: Add chromite bin directory when running devserver

Components: Infra>Client>ChromeOS
run like `ls -Rl /tmp/chromeos-cache/` and post the output here.  it looks like the cache has gotten corrupted somehow.

does it constantly happen ?  if it's a one-off, try nuking the cache:
  rm -rf /tmp/chromeos-cache

although /tmp should also get nuked if you just rebooted the system.
It's not one-off. But I don't know how to re-produce it though I did see it couple of times before.

It might related to deployment of new code. I will run that command next time.
Labels: -Pri-1 Pri-2
Status: Assigned (was: Untriaged)

Sign in to add a comment