New issue
Advanced search Search tips

Issue 730048 link

Starred by 1 user

Issue metadata

Status: Untriaged
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Several builders failing to upload layout test results JSON

Project Member Reported by qyears...@chromium.org, Jun 6 2017

Issue description

Several builders are usually not sending results to test-results.appspot.com because of a failure in "Upload to test-results [webkit_tests]":

In the last 1000 cases of warnings in that step:
  483 were on WebKit Linux Trusty ASAN
  242 were on WebKit Linux Trusty MSAN
  133 were on WebKit Win7 (dbg)
Fewer warnings occurred on other debug builders, and on release builders.

Input JSON file probably has full json results format
Uploading JSON files for builder "WebKit Linux Trusty MSAN" to server "test-results.appspot.com"
INFO:root:Sending request to https://test-results.appspot.com/testfile/upload at 2017-06-06 05:18:03.184266 UTC
WARNING:root:Received HTTP status 500 loading "https://test-results.appspot.com/testfile/upload".  Retrying in 10 seconds...
INFO:root:Sending request to https://test-results.appspot.com/testfile/upload at 2017-06-06 05:19:09.451480 UTC
WARNING:root:Received HTTP status 500 loading "https://test-results.appspot.com/testfile/upload".  Retrying in 15.0 seconds...
INFO:root:Sending request to https://test-results.appspot.com/testfile/upload at 2017-06-06 05:20:13.202316 UTC
WARNING:root:Received HTTP status 500 loading "https://test-results.appspot.com/testfile/upload".  Retrying in 22.5 seconds...
INFO:root:Sending request to https://test-results.appspot.com/testfile/upload at 2017-06-06 05:21:20.251602 UTC
WARNING:root:Received HTTP status 500 loading "https://test-results.appspot.com/testfile/upload".  Retrying in 33.75 seconds...
INFO:root:Sending request to https://test-results.appspot.com/testfile/upload at 2017-06-06 05:22:44.182284 UTC
Traceback (most recent call last):
  File ".../resources/upload_test_results.py", line 200, in <module>
    sys.exit(main(sys.argv[1:]))
  File ".../resources/upload_test_results.py", line 195, in main
    options.test_results_server, attrs, files, 120)
  File ".../resources/test_results_uploader.py", line 51, in upload_test_results
    timeout_secs)
  File ".../resources/test_results_uploader.py", line 128, in _retry_exp_backoff
    return func(timeout_secs - total_sleep)
  File ".../resources/test_results_uploader.py", line 62, in _try_uploading_test_results
    return urllib2.urlopen(request, timeout=timeout_secs)
  File "/usr/lib/python2.7/urllib2.py", line 127, in urlopen
    return _opener.open(url, data, timeout)
  ...
  File "/usr/lib/python2.7/ssl.py", line 260, in read
    return self._sslobj.read(len)
ssl.SSLError: The read operation timed out
step returned non-zero exit code: 1

Example case:
https://build.chromium.org/p/chromium.webkit/builders/WebKit%20Linux%20Trusty%20MSAN/builds/1270

Code link:
https://cs.chromium.org/chromium/build/scripts/slave/recipe_modules/test_results/resources/test_results_uploader.py?q=resources/test_results_uploader.py&sq=package:chromium&dr&l=62
 
Dirk pointed out that actually in a recent run of the MSAN builder[1], there are actually results[2].
In the build where there were results (1271), the error was SSLError (shown above). In builds where the appears not to have been results (e.g. 1270), the error was actually like this:

Input JSON file probably has full json results format
Uploading JSON files for builder "WebKit Linux Trusty MSAN" to server "test-results.appspot.com"
INFO:root:Sending request to https://test-results.appspot.com/testfile/upload at 2017-06-06 10:48:01.710527 UTC
Traceback:
  ...
  File ".../resources/test_results_uploader.py", line 135, in _retry_exp_backoff
    % (e.code, e.filename, e.read()))
test_results_uploader.PermanentError: Received HTTP status 400 loading "https://test-results.appspot.com/testfile/upload": failed to load DataEntry object: Call error 11: Deadline exceeded (timeout)
step returned non-zero exit code: 1


[1] https://build.chromium.org/p/chromium.webkit/builders/WebKit%20Linux%20Trusty%20MSAN/builds/1271
[2] https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=webkit_tests&tests=inspector/sources/debugger-pause/pause-on-elements-panel.html
qyearsley@, this is a P2 but with nobody assigned. Should it be a P2, and what are the next steps?
Components: Infra>Flakiness>Dashboard
Labels: -Pri-2 Pri-3
This is not time critical so it can be a P3.

This issue appears to still frequently occur on the builders mentioned above:

  WebKit Linux Trusty ASAN
  WebKit Linux Trusty MSAN
  WebKit Win7 (dbg)

Related to other data issues for test-results.appspot.com such as bug 792175.

One possible next step here will be to find out why these builders take longer to upload results than other builders; is it just because they have more failing tests?

It's possible that later this year there might be bigger overall changes to test-results that would make this bug obsolete.
Project Member

Comment 4 by sheriffbot@chromium.org, Jan 3

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Sign in to add a comment