"No such file" when cleaning up working directory on Swarming Linux bot |
|||||
Issue descriptionIt occasionally fails otherwise successful tests. Example: https://chromium-swarm.appspot.com/task?id=36bb7af6743e5710&refresh=10&show_raw=1 SUCCESS: all tests passed. Failed to delete /b/s/w/ir (3 files remaining). Maybe the test has a subprocess outliving it. Sleeping 2 seconds. Failed to delete /b/s/w/itwfxEJU (86 files remaining). Maybe the test has a subprocess outliving it. Sleeping 2 seconds. Failed to delete /b/s/w/itwfxEJU (2 files remaining). Maybe the test has a subprocess outliving it. Sleeping 4 seconds. Failed to delete /b/s/w/itwfxEJU. The following files remain: - /b/s/w/itwfxEJU - /b/s/w/itwfxEJU 14260 2017-06-13 18:24:47.362 E: Failure with [Errno 2] No such file or directory: '/b/s/w/itwfxEJU' *** Swarming tried multiple times to delete the temp directory and failed *** *** Hard failing the task *** -------- It is Linux. Why files are locked? (do they?) Why same file is listed twice? Why "no such file" is an error during deletion?
,
Jun 14 2017
The task Dales referenced to is timing out after 1h.
,
Jun 15 2017
+current troopers
,
Jun 15 2017
I will prepare some cls to roll back swarming on Linux Dbg.
,
Jun 15 2017
It looks like I accidently reduced the number of shards for the debug bot to 1 in https://codereview.chromium.org/2939913002/ which is causing swarming to timeout.
,
Jun 15 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/bbfa94edc35a58fac121884f5b3a668ee34ed670 commit bbfa94edc35a58fac121884f5b3a668ee34ed670 Author: tansell <tansell@chromium.org> Date: Thu Jun 15 03:30:18 2017 chromium.webkit: Fix WebKit Linux Trusty (dbg) builder. In https://codereview.chromium.org/2939913002/ the number of shards was accidently removed, causing on a single shard to be used. A single shard takes longer than an hour, so it times out causing failure. With 6 shards, it takes about 45 minutes to run. BUG= 703894 , 524758 , 732891 TBR=mcgreevy@chromium.org,dpranke@chromium.org,phajdan.jr@chromium.org NOTRY=true Review-Url: https://codereview.chromium.org/2940053002 Cr-Commit-Position: refs/heads/master@{#479592} [modify] https://crrev.com/bbfa94edc35a58fac121884f5b3a668ee34ed670/testing/buildbot/chromium.webkit.json
,
Jun 15 2017
I have landed a fix for the issue dalecurtis linked, but the first issue reported by vadimsh seem unrelated to the issue that dalecurtis linked? It is for 'Linux ChromiumOS Tests' which I know nothing about?
,
Jun 15 2017
There was 3 problems: - Confusing error message, what this bug is about; it was about browser_tests. - The fact that xvfb doesn't handle SIGTERM properly. File issue 733612. - The webkit timeout issue, which is actually unrelated to this problem here.
,
Jun 17 2017
The following revision refers to this bug: https://chromium.googlesource.com/external/github.com/luci/luci-py.git/+/32f1b4e8be313e65e99b5de5a7255f66452db4be commit 32f1b4e8be313e65e99b5de5a7255f66452db4be Author: maruel <maruel@chromium.org> Date: Sat Jun 17 00:45:33 2017 Improve error handling for file_path.rmtree() If there has been an error while deleting but the directory still disappeared, do not throw. Use a set to not list the same path mulitple times. R=vadimsh@chromium.org BUG= 732891 Review-Url: https://codereview.chromium.org/2934983003 [modify] https://crrev.com/32f1b4e8be313e65e99b5de5a7255f66452db4be/client/utils/file_path.py
,
Jun 20 2017
assigning to maruel@ , since you are already handling this, and it seems this just waits for to be deployed.
,
Jun 21 2017
"Fix" is live. Reopen if seen again. This code will change again soon due to issue |
|||||
►
Sign in to add a comment |
|||||
Comment 1 by dalecur...@chromium.org
, Jun 14 2017Labels: -Pri-2 Pri-1