New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 812009 link

Starred by 1 user

Issue metadata

Status: Duplicate
Owner:
Last visit > 30 days ago
Closed: Feb 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Windows
Pri: 3
Type: Bug



Sign in to add a comment

WebRTC: Lots of broken tasks

Project Member Reported by mar...@chromium.org, Feb 13 2018

Issue description

Example:
https://chromium-swarm.appspot.com/task?id=3ba75afa6c924b10

5012 2018-02-13 16:36:58.631 E: Error while removing named cache u'C:\\b\\s\\w\\ir\\cache\\git' at u'git'. The cache will be lost.
Traceback (most recent call last):
  File "C:\b\s\swarming_bot.1.zip\client\run_isolated.py", line 1241, in install_named_caches
    named_cache_manager.uninstall(path, name)
  File "C:\b\s\swarming_bot.1.zip\client\named_cache.py", line 212, in uninstall
    name, path, ex))
Error: cannot uninstall cache named u'git' at u'C:\\b\\s\\w\\ir\\cache\\git': [Error 5] Access is denied
5012 2018-02-13 16:36:58.678 E: Error while removing named cache u'C:\\b\\s\\w\\ir\\cache\\vpython' at u'vpython'. The cache will be lost.
Traceback (most recent call last):
  File "C:\b\s\swarming_bot.1.zip\client\run_isolated.py", line 1241, in install_named_caches
    named_cache_manager.uninstall(path, name)
  File "C:\b\s\swarming_bot.1.zip\client\named_cache.py", line 212, in uninstall
    name, path, ex))
Error: cannot uninstall cache named u'vpython' at u'C:\\b\\s\\w\\ir\\cache\\vpython': [Error 5] Access is denied
5012 2018-02-13 16:36:58.726 E: Error while removing named cache u'C:\\b\\s\\w\\ir\\cache\\builder' at u'webrtc_win'. The cache will be lost.
Traceback (most recent call last):
  File "C:\b\s\swarming_bot.1.zip\client\run_isolated.py", line 1241, in install_named_caches
    named_cache_manager.uninstall(path, name)
  File "C:\b\s\swarming_bot.1.zip\client\named_cache.py", line 212, in uninstall
    name, path, ex))
Error: cannot uninstall cache named u'webrtc_win' at u'C:\\b\\s\\w\\ir\\cache\\builder': [Error 5] Access is denied


I'm filing this bug mostly because it fills up the failure rate on Swarming. bot_update takes 6 hours, which means it's deeply broken.

Assigning to Edward for triage.
 
Components: -Infra>Platform>Swarming Infra>Client>WebRTC
maruel@ bot_update didn't take 6 hours, 6 hours was pending time. Actual task ran for 1 hour and then apparently Execution timeout of 1h kicked in (this is not obvious, but based on start/end timestamps and task properties, it certainly looks so. I filed issue 812896 to track shadowing of execution timeout by cleanup errors).

Still, WebRTC folks -- please figure out why git fetch hangs for almost 1 hour.
Owner: phoglund@chromium.org
I no longer work for WebRTC.
Patrik, can you take a look.
Mergedinto: 806967
Status: Duplicate (was: Assigned)
Right, this is a known issue with our experimental luci bots. Sorry about that. We should fix this so we don't take up swarming resources.

Sign in to add a comment