New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 732891 link

Starred by 2 users

Issue metadata

Status: Fixed
Owner:
Closed: Jun 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Linux
Pri: 1
Type: Bug



Sign in to add a comment

"No such file" when cleaning up working directory on Swarming Linux bot

Project Member Reported by vadimsh@chromium.org, Jun 13 2017

Issue description

It occasionally fails otherwise successful tests.

Example: https://chromium-swarm.appspot.com/task?id=36bb7af6743e5710&refresh=10&show_raw=1

SUCCESS: all tests passed.
Failed to delete /b/s/w/ir (3 files remaining).
  Maybe the test has a subprocess outliving it.
  Sleeping 2 seconds.
Failed to delete /b/s/w/itwfxEJU (86 files remaining).
  Maybe the test has a subprocess outliving it.
  Sleeping 2 seconds.
Failed to delete /b/s/w/itwfxEJU (2 files remaining).
  Maybe the test has a subprocess outliving it.
  Sleeping 4 seconds.
Failed to delete /b/s/w/itwfxEJU. The following files remain:
- /b/s/w/itwfxEJU
- /b/s/w/itwfxEJU
14260 2017-06-13 18:24:47.362 E: Failure with [Errno 2] No such file or directory: '/b/s/w/itwfxEJU'
*** Swarming tried multiple times to delete the temp directory and failed ***
*** Hard failing the task ***

--------

It is Linux. Why files are locked? (do they?) Why same file is listed twice? Why "no such file" is an error during deletion?
 
Cc: tansell@chromium.org
Labels: -Pri-2 Pri-1
This is consistently failing on Linux Dbg after swarming was enabled: https://chromium-swarm.appspot.com/task?id=36c128273a4b7110&refresh=10&show_raw=1

Comment 2 by mar...@chromium.org, Jun 14 2017

Cc: mcgreevy@chromium.org
Components: Blink>Infra
Labels: OS-Linux
The task Dales referenced to is timing out after 1h.
Cc: aga...@chromium.org smut@chromium.org
+current troopers
I will prepare some cls to roll back swarming on Linux Dbg.
It looks like I accidently reduced the number of shards for the debug bot to 1 in https://codereview.chromium.org/2939913002/ which is causing swarming to timeout.
Project Member

Comment 6 by bugdroid1@chromium.org, Jun 15 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/bbfa94edc35a58fac121884f5b3a668ee34ed670

commit bbfa94edc35a58fac121884f5b3a668ee34ed670
Author: tansell <tansell@chromium.org>
Date: Thu Jun 15 03:30:18 2017

chromium.webkit: Fix WebKit Linux Trusty (dbg) builder.

In https://codereview.chromium.org/2939913002/ the number of shards
was accidently removed, causing on a single shard to be used.

A single shard takes longer than an hour, so it times out causing
failure.

With 6 shards, it takes about 45 minutes to run.

BUG= 703894 , 524758 , 732891 
TBR=mcgreevy@chromium.org,dpranke@chromium.org,phajdan.jr@chromium.org
NOTRY=true

Review-Url: https://codereview.chromium.org/2940053002
Cr-Commit-Position: refs/heads/master@{#479592}

[modify] https://crrev.com/bbfa94edc35a58fac121884f5b3a668ee34ed670/testing/buildbot/chromium.webkit.json

I have landed a fix for the issue dalecurtis linked, but the first issue reported by vadimsh seem unrelated to the issue that dalecurtis linked? 

It is for 'Linux ChromiumOS Tests' which I know nothing about?

Comment 8 by mar...@chromium.org, Jun 15 2017

There was 3 problems:
- Confusing error message, what this bug is about; it was about browser_tests.
- The fact that xvfb doesn't handle SIGTERM properly. File issue 733612.
- The webkit timeout issue, which is actually unrelated to this problem here.
Project Member

Comment 9 by bugdroid1@chromium.org, Jun 17 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/external/github.com/luci/luci-py.git/+/32f1b4e8be313e65e99b5de5a7255f66452db4be

commit 32f1b4e8be313e65e99b5de5a7255f66452db4be
Author: maruel <maruel@chromium.org>
Date: Sat Jun 17 00:45:33 2017

Improve error handling for file_path.rmtree()

If there has been an error while deleting but the directory still disappeared,
do not throw. Use a set to not list the same path mulitple times.

R=vadimsh@chromium.org
BUG= 732891 

Review-Url: https://codereview.chromium.org/2934983003

[modify] https://crrev.com/32f1b4e8be313e65e99b5de5a7255f66452db4be/client/utils/file_path.py

Owner: mar...@chromium.org
Status: Assigned (was: Untriaged)
assigning to maruel@ , since you are already handling this, and it seems this just waits for to be deployed.
Status: Fixed (was: Assigned)
"Fix" is live. Reopen if seen again. This code will change again soon due to issue 

Sign in to add a comment