New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 898504 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 898505
Owner: ----
Closed: Oct 24
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

bob-paladin: Not enough DUTs for requirements, required: 4, found: 3

Project Member Reported by benzh@chromium.org, Oct 24

Issue description

Issue started last night:
https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?id=3066684
https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?id=3067108
https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8931795793831710096


************************************************************
** Start Stage HWTest [provision] - Wed, 24 Oct 2018 03:34:50 -0700 (PDT)
** 
** Stage that runs tests in the Autotest lab.
************************************************************
03:34:50: INFO: Created cidb engine bot@130.211.191.11 for pid 19968
03:34:50: INFO: Running cidb query on pid 19968, repr(query) starts with <sqlalchemy.sql.expression.Update object at 0x7f9ba6ccb4d0>
03:34:50: INFO: Waiting up to forever for payloads and test artifacts ...
Preconditions for the stage successfully met. Beginning to execute stage...
03:41:36: INFO: Running cidb query on pid 19968, repr(query) starts with <sqlalchemy.sql.expression.Update object at 0x7f9ba6d00c50>
03:41:36: INFO: Re-run swarming_cmd to avoid buildbot salency check.
03:41:36: INFO: RunCommand: /b/swarming/w/ir/cache/cbuild/repository/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /b/swarming/w/ir/tmp/t/cbuildbot-tmpk8dfZK/tmpbng3Vc/temp_summary.json --print-status-updates --timeout 9000 --raw-cmd --task-name bob-paladin/R72-11188.0.0-rc1-provision --dimension os Ubuntu-14.04 --dimension pool default --io-timeout 9000 --hard-timeout 9000 --expiration 1200 '--tags=priority:CQ' '--tags=suite:provision' '--tags=build:bob-paladin/R72-11188.0.0-rc1' '--tags=task_name:bob-paladin/R72-11188.0.0-rc1-provision' '--tags=board:bob' -- /usr/local/autotest/site_utils/run_suite.py --build bob-paladin/R72-11188.0.0-rc1 --board bob --suite_name provision --pool cq --file_bugs False --priority CQ --timeout_mins 90 --retry True --max_retries 5 --minimum_duts 4 --suite_args "{u'num_required': 1}" --offload_failures_only False --job_keyvals "{'cidb_build_stage_id': 96865074L, 'cidb_build_id': 3067595, 'datastore_parent_key': ('Build', 3067595, 'BuildStage', 96865074L)}" --test_args "{'fast': 'True'}" -c
03:41:42: WARNING: Exception is not retriable return code: 3; command: /b/swarming/w/ir/cache/cbuild/repository/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /b/swarming/w/ir/tmp/t/cbuildbot-tmpk8dfZK/tmpbng3Vc/temp_summary.json --print-status-updates --timeout 9000 --raw-cmd --task-name bob-paladin/R72-11188.0.0-rc1-provision --dimension os Ubuntu-14.04 --dimension pool default --io-timeout 9000 --hard-timeout 9000 --expiration 1200 '--tags=priority:CQ' '--tags=suite:provision' '--tags=build:bob-paladin/R72-11188.0.0-rc1' '--tags=task_name:bob-paladin/R72-11188.0.0-rc1-provision' '--tags=board:bob' -- /usr/local/autotest/site_utils/run_suite.py --build bob-paladin/R72-11188.0.0-rc1 --board bob --suite_name provision --pool cq --file_bugs False --priority CQ --timeout_mins 90 --retry True --max_retries 5 --minimum_duts 4 --suite_args "{u'num_required': 1}" --offload_failures_only False --job_keyvals "{'cidb_build_stage_id': 96865074L, 'cidb_build_id': 3067595, 'datastore_parent_key': ('Build', 3067595, 'BuildStage', 96865074L)}" --test_args "{'fast': 'True'}" -c
Triggered task: bob-paladin/R72-11188.0.0-rc1-provision
chromeos-golo-server1-33: 40be7be177ebf010 3
  Autotest instance created: cautotest-prod
  TestLabException: Not enough DUTs for requirements: ('board:bob', 'pool:cq'); required: 4, found: 3
  Traceback (most recent call last):
    File "/usr/local/autotest/site_utils/run_suite.py", line 2000, in _run_task
      return _run_suite(options)
    File "/usr/local/autotest/site_utils/run_suite.py", line 1738, in _run_suite
      options.skip_duts_check)
    File "/usr/local/autotest/site_utils/diagnosis_utils.py", line 320, in check_dut_availability
      hosts=hosts)
  NotEnoughDutsError: Not enough DUTs for requirements: ('board:bob', 'pool:cq'); required: 4, found: 3
  Will return from run_suite with status: INFRA_FAILURE
 
Mergedinto: 897885
Status: Duplicate (was: Untriaged)
There was a devserver issue causing provision to fail, thus causing DUTs to be unable to run tests.  Should be fixed now
Mergedinto: -897885 898505
Components: -Infra>Client>ChromeOS>CI Infra>Client>ChromeOS>Test
Labels: -Pri-3 Pri-1

Sign in to add a comment