New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 686127 link

Starred by 1 user

Issue metadata

Status: Archived
Owner: ----
Closed: Feb 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

"too many open files" in check_health

Project Member Reported by semenzato@chromium.org, Jan 27 2017

Issue description

https://uberchromegw.corp.google.com/i/chromeos/builders/caroline-release/builds/350

https://pantheon.corp.google.com/storage/browser/chromeos-autotest-results/98243103-chromeos-test/chromeos2-row8-rack1-host3/debug/

autoserv.DEBUG

This is the snippet of interest.  There are various other failures in that log.

       500 Internal Server Error
        The server encountered an unexpected condition which prevented it from fulfilling the request.
        Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/cherrypy/_cprequest.py", line 656, in respond
    response.body = self.handler()
  File "/usr/lib/python2.7/dist-packages/cherrypy/lib/encoding.py", line 188, in __call__
    self.body = self.oldhandler(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/cherrypy/_cpdispatch.py", line 34, in __call__
    return self.callable(*self.args, **self.kwargs)
  File "/usr/local/google/home/chromeos-test/chromiumos/src/platform/dev/devserver.py", line 1510, in check_health
    apache_client_count = self._get_process_count('apache')
  File "/usr/local/google/home/chromeos-test/chromiumos/src/platform/dev/devserver.py", line 1489, in _get_process_count
    'pgrep -fc "%s"' % process_cmd_pattern, shell=True))
  File "/usr/lib/python2.7/subprocess.py", line 566, in check_output
    process = Popen(stdout=PIPE, *popenargs, **kwargs)
  File "/usr/lib/python2.7/subprocess.py", line 710, in __init__
    errread, errwrite)
  File "/usr/lib/python2.7/subprocess.py", line 1215, in _execute_child
    errpipe_read, errpipe_write = self.pipe_cloexec()
  File "/usr/lib/python2.7/subprocess.py", line 1167, in pipe_cloexec
    r, w = os.pipe()
OSError: [Errno 24] Too many open files

    
    Powered by CherryPy 3.2.2
    
    


01/27 02:20:10.889 ERROR|        dev_server:0404| Devserver call failed: "http://100.108.1.59:8082/check_health?", timeout: 2.0 seconds, Error: retry exception (label="make_call"), timeout = 2s
01/27 02:20:10.904 ERROR|        dev_server:0404| Devserver call failed: "http://172.24.190.211:8082/check_health?", timeout: 2.0 seconds, Error: retry exception (label="make_call"), timeout = 2s
01/27 02:20:10.912 ERROR|        dev_server:0404| Devserver call failed: "http://172.25.61.81:8082/check_health?", timeout: 2.0 seconds, Error: retry exception (label="make_call"), timeout = 2s
01/27 02:20:10.940 ERROR|        dev_server:0404| Devserver call failed: "http://172.25.66.216:8082/check_health?", timeout: 2.0 seconds, Error: retry exception (label="make_call"), timeout = 2s
 
Owner: ----
Not actively looking at this, unless it's hitting multiple runs (deputy hat).
Labels: -current-issue
Status: Unconfirmed (was: Untriaged)
Project Member

Comment 3 by sheriffbot@chromium.org, Feb 12 2018

Status: Archived (was: Unconfirmed)
Issue has not been modified or commented on in the last 365 days, please re-open or file a new bug if this is still an issue.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Sign in to add a comment