net_unittests failing on multiple builders |
||||
Issue descriptionFiled by sheriff-o-matic@appspot.gserviceaccount.com on behalf of hartmanng@google.com net_unittests failing on multiple builders Builders failed on: - KitKat Phone Tester (dbg): https://build.chromium.org/p/chromium.android/builders/KitKat%20Phone%20Tester%20%28dbg%29 - KitKat Phone Tester (rel): https://build.chromium.org/p/chromium.android/builders/KitKat%20Phone%20Tester%20%28rel%29 - Marshmallow 64 bit Tester: https://build.chromium.org/p/chromium.android/builders/Marshmallow%2064%20bit%20Tester - Marshmallow Phone Tester (rel): https://build.chromium.org/p/chromium.android/builders/Marshmallow%20Phone%20Tester%20%28rel%29 ...... too many results, data snipped.... and 40 other(s) in net_unittests failing on chromium.android/Lollipop Phone Tester Builders failed on: - Lollipop Phone Tester: https://build.chromium.org/p/chromium.android/builders/Lollipop%20Phone%20Tester
,
Jan 23 2018
Looks like SSLClientSocketReadTest is the main failure. Not sure who to assign this to, CCing a few people who have touched it the most recently.
,
Jan 23 2018
John, it looks like you've been working on testserver.py recently, could this possibly be related?
,
Jan 23 2018
yeah, revert already landed in https://chromium-review.googlesource.com/c/chromium/src/+/881705
,
Jan 23 2018
thanks! |
||||
►
Sign in to add a comment |
||||
Comment 1 by hartma...@chromium.org
, Jan 23 2018I 772.095s Thread-1 Action for POST method is: /start. I 772.095s Thread-1 Handling request to spawn a test server. I 772.095s Thread-1 184 I 772.095s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 772.095s Thread-44 Start running the thread! I 772.095s Thread-44 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] E 782.106s Thread-44 Failed to wait to the Python test server to be started. E 782.106s Thread-44 Trying to unmap non-forwarded port 0 I 782.106s Thread-44 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:12:59] "POST /start HTTP/1.1" 500 - I 782.107s Thread-1 Encounter problem during starting a test server. I 782.113s Thread-1 Action for POST method is: /start. I 782.113s Thread-1 Handling request to spawn a test server. I 782.113s Thread-1 184 I 782.113s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 782.113s Thread-45 Start running the thread! I 782.113s Thread-45 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] E 792.115s Thread-45 Failed to wait to the Python test server to be started. E 792.115s Thread-45 Trying to unmap non-forwarded port 0 I 792.115s Thread-45 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:13:09] "POST /start HTTP/1.1" 500 - I 792.116s Thread-1 Encounter problem during starting a test server. I 792.121s Thread-1 Action for POST method is: /start. I 792.122s Thread-1 Handling request to spawn a test server. I 792.122s Thread-1 184 I 792.122s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 792.122s Thread-46 Start running the thread! I 792.122s Thread-46 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] E 802.133s Thread-46 Failed to wait to the Python test server to be started. E 802.133s Thread-46 Trying to unmap non-forwarded port 0 I 802.133s Thread-46 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:13:19] "POST /start HTTP/1.1" 500 - I 802.134s Thread-1 Encounter problem during starting a test server. I 802.153s Thread-1 Action for POST method is: /start. I 802.153s Thread-1 Handling request to spawn a test server. I 802.153s Thread-1 184 I 802.153s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 802.153s Thread-47 Start running the thread! I 802.153s Thread-47 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] E 812.164s Thread-47 Failed to wait to the Python test server to be started. E 812.165s Thread-47 Trying to unmap non-forwarded port 0 I 812.165s Thread-47 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:13:29] "POST /start HTTP/1.1" 500 - I 812.165s Thread-1 Encounter problem during starting a test server. I 812.183s Thread-1 Action for POST method is: /start. I 812.184s Thread-1 Handling request to spawn a test server. I 812.184s Thread-1 184 I 812.184s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 812.184s Thread-48 Start running the thread! I 812.184s Thread-48 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] I 815.997s run_tests_on_device(03dabee113b3f535) Still working on StartInstrumentation(03dabee113b3f535, org.chromium.native_test/org.chromium.native_test.NativeTestInstrumentationTestRunner, retries=0, extras={'org.chromium.native_test.NativeTestInstrumentationTestRunner.ShardNanoTimeout': 300000000000, 'org.chromium.native_test.NativeTestInstrumentationTestRunner.NativeTestActivity': 'org.chromium.native_test.NativeUnitTestActivity', 'org.chromium.native_test.NativeTest.RunInSubThread': 1, 'org.chromium.native_test.NativeTestInstrumentationTestRunner.TestList': '/data/local/tmp/temp_file-7b8d79fb4faac', 'org.chromium.native_test.NativeTestInstrumentationTestRunner.StdoutFile': '/storage/emulated/legacy/temp_file-6f77812a2fcc4.gtest_out'}, timeout=300.0, raw=False) E 822.193s Thread-48 Failed to wait to the Python test server to be started. E 822.193s Thread-48 Trying to unmap non-forwarded port 0 I 822.193s Thread-48 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:13:39] "POST /start HTTP/1.1" 500 - I 822.193s Thread-1 Encounter problem during starting a test server. I 822.211s Thread-1 Action for POST method is: /start. I 822.211s Thread-1 Handling request to spawn a test server. I 822.211s Thread-1 184 I 822.212s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 822.212s Thread-49 Start running the thread! I 822.212s Thread-49 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] E 832.223s Thread-49 Failed to wait to the Python test server to be started. E 832.223s Thread-49 Trying to unmap non-forwarded port 0 I 832.223s Thread-49 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:13:49] "POST /start HTTP/1.1" 500 - I 832.224s Thread-1 Encounter problem during starting a test server. I 832.243s Thread-1 Action for POST method is: /start. I 832.243s Thread-1 Handling request to spawn a test server. I 832.243s Thread-1 184 I 832.243s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 832.243s Thread-50 Start running the thread! I 832.243s Thread-50 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] E 842.254s Thread-50 Failed to wait to the Python test server to be started. E 842.255s Thread-50 Trying to unmap non-forwarded port 0 I 842.255s Thread-50 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:13:59] "POST /start HTTP/1.1" 500 - I 842.255s Thread-1 Encounter problem during starting a test server. I 842.274s Thread-1 Action for POST method is: /start. I 842.275s Thread-1 Handling request to spawn a test server. I 842.275s Thread-1 184 I 842.275s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 842.275s Thread-51 Start running the thread! I 842.275s Thread-51 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] E 852.286s Thread-51 Failed to wait to the Python test server to be started. E 852.286s Thread-51 Trying to unmap non-forwarded port 0 I 852.286s Thread-51 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:14:09] "POST /start HTTP/1.1" 500 - I 852.287s Thread-1 Encounter problem during starting a test server. I 852.292s Thread-1 Action for POST method is: /start. I 852.292s Thread-1 Handling request to spawn a test server. I 852.292s Thread-1 184 I 852.293s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 852.293s Thread-52 Start running the thread! I 852.293s Thread-52 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] E 862.295s Thread-52 Failed to wait to the Python test server to be started. E 862.295s Thread-52 Trying to unmap non-forwarded port 0 I 862.295s Thread-52 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:14:19] "POST /start HTTP/1.1" 500 - I 862.295s Thread-1 Encounter problem during starting a test server. I 862.322s Thread-1 Action for POST method is: /start. I 862.322s Thread-1 Handling request to spawn a test server. I 862.322s Thread-1 184 I 862.322s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 862.322s Thread-53 Start running the thread! I 862.322s Thread-53 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] E 872.333s Thread-53 Failed to wait to the Python test server to be started. E 872.333s Thread-53 Trying to unmap non-forwarded port 0 I 872.334s Thread-53 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:14:29] "POST /start HTTP/1.1" 500 - I 878.168s Thread-1 Action for POST method is: /start. I 878.168s Thread-1 Handling request to spawn a test server. I 878.168s Thread-1 189 I 878.168s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/expired_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 878.168s Thread-54 Start running the thread! I 878.168s Thread-54 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/expired_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] E 888.179s Thread-54 Failed to wait to the Python test server to be started. E 888.179s Thread-54 Trying to unmap non-forwarded port 0 I 888.179s Thread-54 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:14:45] "POST /start HTTP/1.1" 500 - I 888.180s Thread-1 Encounter problem during starting a test server. I 888.215s Thread-1 Action for POST method is: /start. I 888.215s Thread-1 Handling request to spawn a test server. I 888.215s Thread-1 184 I 888.215s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"localhost","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http"} I 888.215s Thread-55 Start running the thread! I 888.215s Thread-55 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=localhost', u'--port=0'] E 898.226s Thread-55 Failed to wait to the Python test server to be started. E 898.226s Thread-55 Trying to unmap non-forwarded port 0 I 898.226s Thread-55 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:14:55] "POST /start HTTP/1.1" 500 - I 898.227s Thread-1 Encounter problem during starting a test server. I 898.252s Thread-1 Action for POST method is: /start. I 898.252s Thread-1 Handling request to spawn a test server. I 898.252s Thread-1 207 I 898.252s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http","ssl-client-auth":null} I 898.252s Thread-56 Start running the thread! I 898.252s Thread-56 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--ssl-client-auth', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] E 908.263s Thread-56 Failed to wait to the Python test server to be started. E 908.263s Thread-56 Trying to unmap non-forwarded port 0 I 908.263s Thread-56 Test-server has died. 127.0.0.1 - - [23/Jan/2018 17:15:05] "POST /start HTTP/1.1" 500 - I 908.264s Thread-1 Encounter problem during starting a test server. I 908.281s Thread-1 Action for POST method is: /start. I 908.281s Thread-1 Handling request to spawn a test server. I 908.281s Thread-1 207 I 908.281s Thread-1 {"cert-and-key-file":"net/data/ssl/certificates/ok_cert.pem","data-dir":".","host":"127.0.0.1","https":null,"log-to-console":null,"on-remote-server":null,"port":0,"server-type":"http","ssl-client-auth":null} I 908.282s Thread-57 Start running the thread! I 908.282s Thread-57 Running: ['/b/swarming/w/ir/net/tools/testserver/testserver.py', '--startup-pipe=22', u'--data-dir=.', u'--https', u'--on-remote-server', u'--ssl-client-auth', u'--cert-and-key-file=net/data/ssl/certificates/ok_cert.pem', u'--log-to-console', u'--host=127.0.0.1', u'--port=0'] Exception in thread Thread-57: Traceback (most recent call last): File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner self.run() File "/b/swarming/w/ir/build/util/lib/common/chrome_test_server_spawner.py", line 248, in run File "/usr/lib/python2.7/subprocess.py", line 711, in __init__ errread, errwrite) File "/usr/lib/python2.7/subprocess.py", line 1343, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory: '/b/swarming/w/ir'