timeout exception in create_suite with no other information available |
|||||
Issue descriptionThis is in atlas-release builder: https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8924089046714808864 It contains a failed swarming.py 06:03:10: INFO: RunCommand: /b/swarming/w/ir/cache/cbuild/repository/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /b/swarming/w/ir/tmp/t/cbuildbot-tmp18BDGj/tmpsnAneL/temp_summary.json --print-status-updates --timeout 14400 --raw-cmd --task-name atlas-release/R73-11599.0.0-sanity --dimension os Ubuntu-14.04 --dimension pool default --io-timeout 14400 --hard-timeout 14400 --expiration 1200 '--tags=priority:Build' '--tags=suite:sanity' '--tags=build:atlas-release/R73-11599.0.0' '--tags=task_name:atlas-release/R73-11599.0.0-sanity' '--tags=board:atlas' -- /usr/local/autotest/site_utils/run_suite.py --build atlas-release/R73-11599.0.0 --board atlas --suite_name sanity --pool bvt --file_bugs True --priority Build --timeout_mins 180 --retry True --max_retries 5 --minimum_duts 1 --suite_min_duts 1 --offload_failures_only False --job_keyvals "{'cidb_build_stage_id': 107620254L, 'cidb_build_id': 3368814, 'datastore_parent_key': ('Build', 3368814, 'BuildStage', 107620254L)}" -c [1;33m06:13:19: WARNING: Exception is not retriable return code: 1; command: /b/swarming/w/ir/cache/cbuild/repository/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /b/swarming/w/ir/tmp/t/cbuildbot-tmp18BDGj/tmpsnAneL/temp_summary.json --print-status-updates --timeout 14400 --raw-cmd --task-name atlas-release/R73-11599.0.0-sanity --dimension os Ubuntu-14.04 --dimension pool default --io-timeout 14400 --hard-timeout 14400 --expiration 1200 '--tags=priority:Build' '--tags=suite:sanity' '--tags=build:atlas-release/R73-11599.0.0' '--tags=task_name:atlas-release/R73-11599.0.0-sanity' '--tags=board:atlas' -- /usr/local/autotest/site_utils/run_suite.py --build atlas-release/R73-11599.0.0 --board atlas --suite_name sanity --pool bvt --file_bugs True --priority Build --timeout_mins 180 --retry True --max_retries 5 --minimum_duts 1 --suite_min_duts 1 --offload_failures_only False --job_keyvals "{'cidb_build_stage_id': 107620254L, 'cidb_build_id': 3368814, 'datastore_parent_key': ('Build', 3368814, 'BuildStage', 107620254L)}" -c and later: Autotest instance created: cautotest-prod 01-17-2019 [06:03:16] Submitted create_suite_job rpc Traceback (most recent call last): File "/usr/local/autotest/site_utils/run_suite.py", line 2076, in <module> sys.exit(main()) File "/usr/local/autotest/site_utils/run_suite.py", line 2065, in main result = _run_task(options) File "/usr/local/autotest/site_utils/run_suite.py", line 2000, in _run_task return _run_suite(options) File "/usr/local/autotest/site_utils/run_suite.py", line 1739, in _run_suite job_id = create_suite(afe, options) File "/usr/local/autotest/client/common_lib/cros/retry.py", line 252, in func_retry raise error.TimeoutException(exception_message) autotest_lib.client.common_lib.error.TimeoutException: retry exception (function="create_suite()"), timeout = 600s I found no other clue in this or other logs. Is it the case that some system component could be logging some more information?
,
Jan 17
(5 days ago)
Also pyro-release. https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8924088946098248448
,
Jan 17
(5 days ago)
Also samus-release. https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8924088938805772240 I won't add any more for this release build.
,
Jan 17
(5 days ago)
,
Jan 18
(4 days ago)
This has now killed two CQ builds. https://ci.chromium.org/p/chromeos/builders/luci.chromeos.general/CQ/b8924004122789855472 https://ci.chromium.org/p/chromeos/builders/luci.chromeos.general/CQ/b8924004073274509392 Probably needs attention.
,
Jan 18
(4 days ago)
Issue 923408 has been merged into this issue.
,
Jan 19
(3 days ago)
This single-handedly broke a CQ run. https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8923915263016139536 |
|||||
►
Sign in to add a comment |
|||||
Comment 1 by semenzato@chromium.org
, Jan 17 (5 days ago)