New issue
Advanced search Search tips

Issue 876415 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Aug 24
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

Cron to update the Docserver is not working

Project Member Reported by karandeepb@chromium.org, Aug 21

Issue description

The cron to update the Docserver doesn't seem to work. https://developer.chrome.com/_query_commit/master shows the most recent commit to be made on Aug 14th. 

From the VM logs,

A  Aug 21 16:00:01 git-processor-cron CRON[2304]: (git-processor) CMD (/usr/bin/env bash /home/git-processor/update-docs-full.sh 2>&1 | /usr/bin/logger) 
A  Aug 21 16:00:01 git-processor-cron git-processor: Acquiring docserver update lock... 
A  Aug 21 16:00:01 git-processor-cron git-processor: Starting git pull 
A  Aug 21 16:00:02 git-processor-cron git-processor: error: Pulling is not possible because you have unmerged files. 
A  Aug 21 16:00:02 git-processor-cron git-processor: hint: Fix them up in the work tree, and then use 'git add/rm <file>' 
A  Aug 21 16:00:02 git-processor-cron git-processor: hint: as appropriate to mark resolution and make a commit. 
A  Aug 21 16:00:02 git-processor-cron git-processor: fatal: Exiting because of an unresolved conflict. 
A  Aug 21 16:00:02 git-processor-cron git-processor: git pull done 
A  Aug 21 16:00:02 git-processor-cron git-processor: INFO:root:Starting refresh from commit 5f069582b9f87d7953b03993e9707c569722896e... 
A  Aug 21 16:00:02 git-processor-cron git-processor: INFO:root:Updating articles... 
A  Aug 21 16:00:13 git-processor-cron git-processor: INFO:root:Updating articles took 11 seconds 
A  Aug 21 16:00:13 git-processor-cron git-processor: INFO:root:Updating owners... 
A  Aug 21 16:00:42 git-processor-cron git-processor: INFO:root:Updating owners took 29 seconds 
A  Aug 21 16:00:42 git-processor-cron git-processor: INFO:root:Updating apis... 
A  Aug 21 16:01:46 git-processor-cron git-processor: ERROR:root:APIDataSource: error Traceback (most recent call last): 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/update_cache.py", line 99, in _UpdateDataSource 
A  Aug 21 16:01:46 git-processor-cron git-processor:     data_source.Refresh().Get() 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/future.py", line 129, in Get 
A  Aug 21 16:01:46 git-processor-cron git-processor:     self._Raise() 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/future.py", line 125, in Get 
A  Aug 21 16:01:46 git-processor-cron git-processor:     self._value = self._callback() 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/future.py", line 30, in resolve 
A  Aug 21 16:01:46 git-processor-cron git-processor:     resolved.append(f.Get()) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/future.py", line 129, in Get 
A  Aug 21 16:01:46 git-processor-cron git-processor:     self._Raise() 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/future.py", line 125, in Get 
A  Aug 21 16:01:46 git-processor-cron git-processor:     self._value = self._callback() 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/future.py", line 30, in resolve 
A  Aug 21 16:01:46 git-processor-cron git-processor:     resolved.append(f.Get()) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/future.py", line 129, in Get 
A  Aug 21 16:01:46 git-processor-cron git-processor:     self._Raise() 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/future.py", line 125, in Get 
A  Aug 21 16:01:46 git-processor-cron git-processor:     self._value = self._callback() 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/api_data_source.py", line 74, in resolve 
A  Aug 21 16:01:46 git-processor-cron git-processor:     self._request) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/jsc_view.py", line 639, in CreateJSCView 
A  Aug 21 16:01:46 git-processor-cron git-processor:     samples).ToDict(request) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/jsc_view.py", line 124, in __init__ 
A  Aug 21 16:01:46 git-processor-cron git-processor:     self._availability = availability_finder.GetAPIAvailability(jsc_model.name) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/availability_finder.py", line 379, in GetAPIAvailability 
A  Aug 21 16:01:46 git-processor-cron git-processor:     check_api_availability) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/host_file_system_iterator.py", line 37, in Descending 
A  Aug 21 16:01:46 git-processor-cron git-processor:     return self._ForEach(channel_info, callback, self._branch_utility.Older) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/host_file_system_iterator.py", line 26, in _ForEach 
A  Aug 21 16:01:46 git-processor-cron git-processor:     file_system = self._file_system_provider.GetBranch(channel_info.branch) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/third_party/json_schema_compiler/memoize.py", line 12, in impl 
A  Aug 21 16:01:46 git-processor-cron git-processor:     memory[full_args] = fn(*args, **optargs) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/host_file_system_provider.py", line 81, in GetBranch 
A  Aug 21 16:01:46 git-processor-cron git-processor:     return self._Create(branch) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/host_file_system_provider.py", line 92, in _Create 
A  Aug 21 16:01:46 git-processor-cron git-processor:     file_system = LocalGitFileSystem.Create(branch=branch, commit=commit) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/local_git_file_system.py", line 23, in Create 
A  Aug 21 16:01:46 git-processor-cron git-processor:     return LocalGitFileSystem(branch, commit) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/local_git_file_system.py", line 36, in __init__ 
A  Aug 21 16:01:46 git-processor-cron git-processor:     self._commit = local_git_util.ParseRevision(commit) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/local_git_util.py", line 39, in ParseRevision 
A  Aug 21 16:01:46 git-processor-cron git-processor:     return RunGit('rev-parse', [name]).rstrip() 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/local_git_util.py", line 35, in RunGit 
A  Aug 21 16:01:46 git-processor-cron git-processor:     cwd=_GetRoot()) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/usr/lib/python2.7/subprocess.py", line 219, in check_output 
A  Aug 21 16:01:46 git-processor-cron git-processor:     raise CalledProcessError(retcode, cmd, output=output) 
A  Aug 21 16:01:46 git-processor-cron git-processor: CalledProcessError: Command '['git', 'rev-parse', u'branch-heads/3521']' returned non-zero exit status 128 
A  Aug 21 16:01:46 git-processor-cron git-processor:  
A  Aug 21 16:01:46 git-processor-cron git-processor: INFO:root:Updating apis took 63 seconds 
A  Aug 21 16:01:46 git-processor-cron git-processor: Traceback (most recent call last): 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/update_cache.py", line 205, in <module> 
A  Aug 21 16:01:46 git-processor-cron git-processor:     _Main(sys.argv[1:]) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/update_cache.py", line 186, in _Main 
A  Aug 21 16:01:46 git-processor-cron git-processor:     UpdateCache(commit=commit) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/update_cache.py", line 125, in UpdateCache 
A  Aug 21 16:01:46 git-processor-cron git-processor:     _UpdateDataSource(name, source) 
A  Aug 21 16:01:46 git-processor-cron git-processor:   File "/home/git-processor/chrome/src/chrome/common/extensions/docs/server2/update_cache.py", line 102, in _UpdateDataSource 
A  Aug 21 16:01:46 git-processor-cron git-processor:     raise e 
A  Aug 21 16:01:46 git-processor-cron git-processor: subprocess.CalledProcessError: Command '['git', 'rev-parse', u'branch-heads/3521']' returned non-zero exit status 128 

 
Components: Platform>Extensions>Documentation
Status: Fixed (was: Assigned)
The git repo somehow managed to get merge failures. I have resolved this for now and the last cron completed successfully. But I can see that git pull is taking quite a long time. I have changed the cron job to run every 5 hours for now. 

Sign in to add a comment