https://uberchromegw.corp.google.com/i/chromeos/builders/caroline-release/builds/350
https://pantheon.corp.google.com/storage/browser/chromeos-autotest-results/98243103-chromeos-test/chromeos2-row8-rack1-host3/debug/
autoserv.DEBUG
This is the snippet of interest. There are various other failures in that log.
500 Internal Server Error
The server encountered an unexpected condition which prevented it from fulfilling the request.
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/cherrypy/_cprequest.py", line 656, in respond
response.body = self.handler()
File "/usr/lib/python2.7/dist-packages/cherrypy/lib/encoding.py", line 188, in __call__
self.body = self.oldhandler(*args, **kwargs)
File "/usr/lib/python2.7/dist-packages/cherrypy/_cpdispatch.py", line 34, in __call__
return self.callable(*self.args, **self.kwargs)
File "/usr/local/google/home/chromeos-test/chromiumos/src/platform/dev/devserver.py", line 1510, in check_health
apache_client_count = self._get_process_count('apache')
File "/usr/local/google/home/chromeos-test/chromiumos/src/platform/dev/devserver.py", line 1489, in _get_process_count
'pgrep -fc "%s"' % process_cmd_pattern, shell=True))
File "/usr/lib/python2.7/subprocess.py", line 566, in check_output
process = Popen(stdout=PIPE, *popenargs, **kwargs)
File "/usr/lib/python2.7/subprocess.py", line 710, in __init__
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1215, in _execute_child
errpipe_read, errpipe_write = self.pipe_cloexec()
File "/usr/lib/python2.7/subprocess.py", line 1167, in pipe_cloexec
r, w = os.pipe()
OSError: [Errno 24] Too many open files
Powered by CherryPy 3.2.2
01/27 02:20:10.889 ERROR| dev_server:0404| Devserver call failed: "http://100.108.1.59:8082/check_health?", timeout: 2.0 seconds, Error: retry exception (label="make_call"), timeout = 2s
01/27 02:20:10.904 ERROR| dev_server:0404| Devserver call failed: "http://172.24.190.211:8082/check_health?", timeout: 2.0 seconds, Error: retry exception (label="make_call"), timeout = 2s
01/27 02:20:10.912 ERROR| dev_server:0404| Devserver call failed: "http://172.25.61.81:8082/check_health?", timeout: 2.0 seconds, Error: retry exception (label="make_call"), timeout = 2s
01/27 02:20:10.940 ERROR| dev_server:0404| Devserver call failed: "http://172.25.66.216:8082/check_health?", timeout: 2.0 seconds, Error: retry exception (label="make_call"), timeout = 2s
Comment 1 by pprabhu@chromium.org
, Jan 27 2017