New issue
Advanced search Search tips

Issue 834454 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Apr 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

eve-tot-chrome-pfq-informational fails NotEnoughDutsError: Not enough DUTs for board: eve, pool: continuous; required: 4, found: 3

Project Member Reported by jdufault@chromium.org, Apr 18 2018

Issue description

FYI. Looks like it went down Friday night/Saturday morning (April 13 or 14)

Example failure https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8948884688373369600

Log snippet:

Priority was reset to 100
Triggered task: eve-tot-chrome-pfq-informational/R68-10595.0.0-b2490725-provision
chromeos-golo-server2-94: 3cf31defc2598b10 3
  Autotest instance created: cautotest-prod
  TestLabException: Not enough DUTs for board: eve, pool: continuous; required: 4, found: 3
  Traceback (most recent call last):
    File "/usr/local/autotest/site_utils/run_suite.py", line 2034, in _run_task
      return _run_suite(options)
    File "/usr/local/autotest/site_utils/run_suite.py", line 1775, in _run_suite
      options.skip_duts_check)
    File "/usr/local/autotest/site_utils/diagnosis_utils.py", line 330, in check_dut_availability
      hosts=hosts)
  NotEnoughDutsError: Not enough DUTs for board: eve, pool: continuous; required: 4, found: 3
  Will return from run_suite with status: INFRA_FAILURE
cmd=['/b/swarming/w/ir/cache/cbuild/repository/chromite/third_party/swarming.client/swarming.py', 'run', '--swarming', 'chromeos-proxy.appspot.com', '--task-summary-json', '/b/swarming/w/ir/tmp/cbuildbot-tmp0L_nVZ/tmp5HwKdw/temp_summary.json', '--raw-cmd', '--task-name', u'eve-tot-chrome-pfq-informational/R68-10595.0.0-b2490725-provision', '--dimension', 'os', 'Ubuntu-14.04', '--dimension', 'pool', 'default', '--print-status-updates', '--timeout', '14400', '--io-timeout', '14400', '--hard-timeout', '14400', '--expiration', '1200', u'--tags=priority:PFQ', u'--tags=suite:provision', u'--tags=build:eve-tot-chrome-pfq-informational/R68-10595.0.0-b2490725', u'--tags=task_name:eve-tot-chrome-pfq-informational/R68-10595.0.0-b2490725-provision', u'--tags=board:eve', '--', '/usr/local/autotest/site_utils/run_suite.py', '--build', u'eve-tot-chrome-pfq-informational/R68-10595.0.0-b2490725', '--board', u'eve', '--suite_name', u'provision', '--pool', u'continuous', '--file_bugs', 'True', '--priority', 'PFQ', '--timeout_mins', '180', '--retry', 'False', '--minimum_duts', '4', '--suite_args', "{u'num_required': 1}", '--offload_failures_only', 'False', '--job_keyvals', "{'cidb_build_stage_id': 77048515L, 'cidb_build_id': 2490725, 'datastore_parent_key': ('Build', 2490725, 'BuildStage', 77048515L)}", '-c']
Autotest instance created: cautotest-prod
 

Comment 1 by xixuan@chromium.org, Apr 18 2018

Status: Fixed (was: Untriaged)
Increase the pool size for 'continuous' from 3 to 5:

xixuan@xixuan0:~/chromiumos/src/third_party/autotest/files$ dut-status -b eve -p continuous
hostname                       S   last checked         URL
chromeos6-row4-rack11-host13   OK  2018-04-17 20:55:05  http://cautotest.corp.google.com/tko/retrieve_logs.cgi?job=/results/hosts/chromeos6-row4-rack11-host13/759240-verify/
chromeos6-row4-rack12-host1    OK  2018-04-17 20:55:05  http://cautotest.corp.google.com/tko/retrieve_logs.cgi?job=/results/hosts/chromeos6-row4-rack12-host1/759241-verify/
chromeos6-row4-rack12-host9    OK  2018-04-17 20:55:05  http://cautotest.corp.google.com/tko/retrieve_logs.cgi?job=/results/hosts/chromeos6-row4-rack12-host9/759242-verify/
chromeos6-row4-rack17-host4    OK  2018-04-18 12:22:46  http://cautotest.corp.google.com/tko/retrieve_logs.cgi?job=/results/hosts/chromeos6-row4-rack17-host4/765517-reset/
chromeos6-row4-rack17-host6    OK  2018-04-18 12:24:13  http://cautotest.corp.google.com/tko/retrieve_logs.cgi?job=/results/hosts/chromeos6-row4-rack17-host6/765526-reset/

Sign in to add a comment