Several builders failing to upload layout test results JSON |
|||
Issue descriptionSeveral builders are usually not sending results to test-results.appspot.com because of a failure in "Upload to test-results [webkit_tests]": In the last 1000 cases of warnings in that step: 483 were on WebKit Linux Trusty ASAN 242 were on WebKit Linux Trusty MSAN 133 were on WebKit Win7 (dbg) Fewer warnings occurred on other debug builders, and on release builders. Input JSON file probably has full json results format Uploading JSON files for builder "WebKit Linux Trusty MSAN" to server "test-results.appspot.com" INFO:root:Sending request to https://test-results.appspot.com/testfile/upload at 2017-06-06 05:18:03.184266 UTC WARNING:root:Received HTTP status 500 loading "https://test-results.appspot.com/testfile/upload". Retrying in 10 seconds... INFO:root:Sending request to https://test-results.appspot.com/testfile/upload at 2017-06-06 05:19:09.451480 UTC WARNING:root:Received HTTP status 500 loading "https://test-results.appspot.com/testfile/upload". Retrying in 15.0 seconds... INFO:root:Sending request to https://test-results.appspot.com/testfile/upload at 2017-06-06 05:20:13.202316 UTC WARNING:root:Received HTTP status 500 loading "https://test-results.appspot.com/testfile/upload". Retrying in 22.5 seconds... INFO:root:Sending request to https://test-results.appspot.com/testfile/upload at 2017-06-06 05:21:20.251602 UTC WARNING:root:Received HTTP status 500 loading "https://test-results.appspot.com/testfile/upload". Retrying in 33.75 seconds... INFO:root:Sending request to https://test-results.appspot.com/testfile/upload at 2017-06-06 05:22:44.182284 UTC Traceback (most recent call last): File ".../resources/upload_test_results.py", line 200, in <module> sys.exit(main(sys.argv[1:])) File ".../resources/upload_test_results.py", line 195, in main options.test_results_server, attrs, files, 120) File ".../resources/test_results_uploader.py", line 51, in upload_test_results timeout_secs) File ".../resources/test_results_uploader.py", line 128, in _retry_exp_backoff return func(timeout_secs - total_sleep) File ".../resources/test_results_uploader.py", line 62, in _try_uploading_test_results return urllib2.urlopen(request, timeout=timeout_secs) File "/usr/lib/python2.7/urllib2.py", line 127, in urlopen return _opener.open(url, data, timeout) ... File "/usr/lib/python2.7/ssl.py", line 260, in read return self._sslobj.read(len) ssl.SSLError: The read operation timed out step returned non-zero exit code: 1 Example case: https://build.chromium.org/p/chromium.webkit/builders/WebKit%20Linux%20Trusty%20MSAN/builds/1270 Code link: https://cs.chromium.org/chromium/build/scripts/slave/recipe_modules/test_results/resources/test_results_uploader.py?q=resources/test_results_uploader.py&sq=package:chromium&dr&l=62
,
Jan 2 2018
qyearsley@, this is a P2 but with nobody assigned. Should it be a P2, and what are the next steps?
,
Jan 2 2018
This is not time critical so it can be a P3. This issue appears to still frequently occur on the builders mentioned above: WebKit Linux Trusty ASAN WebKit Linux Trusty MSAN WebKit Win7 (dbg) Related to other data issues for test-results.appspot.com such as bug 792175. One possible next step here will be to find out why these builders take longer to upload results than other builders; is it just because they have more failing tests? It's possible that later this year there might be bigger overall changes to test-results that would make this bug obsolete.
,
Jan 3
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue. Sorry for the inconvenience if the bug really should have been left as Available. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot |
|||
►
Sign in to add a comment |
|||
Comment 1 by qyears...@chromium.org
, Jun 6 2017