New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 768021 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner: ----
Closed: Sep 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

tricky, peach_pit, veyron_minnie chrome informational PFQ failed HWTest due to timeout

Project Member Reported by x...@chromium.org, Sep 22 2017

Issue description

tricky: https://uberchromegw.corp.google.com/i/chromeos.chrome/builders/tricky-tot-chrome-pfq-informational/builds/6144
peach_pit:
https://uberchromegw.corp.google.com/i/chromeos.chrome/builders/peach_pit-tot-chrome-pfq-informational/builds/7904
veyron_minnie:
https://uberchromegw.corp.google.com/i/chromeos.chrome/builders/veyron_minnie-tot-chrome-pfq-informational/builds/6128


Selected error message:
12:31:29: INFO: RunCommand: /b/c/cbuild/repository/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /tmp/cbuildbot-tmpNgt35q/tmpb2pyt0/temp_summary.json --raw-cmd --task-name peach_pit-tot-chrome-pfq-informational/R63-9965.0.0-b7904-bvt-arc --dimension os Ubuntu-14.04 --dimension pool default --print-status-updates --timeout 14400 --io-timeout 14400 --hard-timeout 14400 --expiration 1200 '--tags=priority:PFQ' '--tags=suite:bvt-arc' '--tags=build:peach_pit-tot-chrome-pfq-informational/R63-9965.0.0-b7904' '--tags=task_name:peach_pit-tot-chrome-pfq-informational/R63-9965.0.0-b7904-bvt-arc' '--tags=board:peach_pit' -- /usr/local/autotest/site_utils/run_suite.py --build peach_pit-tot-chrome-pfq-informational/R63-9965.0.0-b7904 --board peach_pit --suite_name bvt-arc --pool continuous --num 6 --file_bugs True --priority PFQ --timeout_mins 180 --retry False --minimum_duts 4 --offload_failures_only False --job_keyvals "{'cidb_build_stage_id': 56846793L, 'cidb_build_id': 1875690, 'datastore_parent_key': ('Build', 1875690, 'BuildStage', 56846793L)}" -c
13:01:36: WARNING: Exception is not retriable return code: 1; command: /b/c/cbuild/repository/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /tmp/cbuildbot-tmpNgt35q/tmpb2pyt0/temp_summary.json --raw-cmd --task-name peach_pit-tot-chrome-pfq-informational/R63-9965.0.0-b7904-bvt-arc --dimension os Ubuntu-14.04 --dimension pool default --print-status-updates --timeout 14400 --io-timeout 14400 --hard-timeout 14400 --expiration 1200 '--tags=priority:PFQ' '--tags=suite:bvt-arc' '--tags=build:peach_pit-tot-chrome-pfq-informational/R63-9965.0.0-b7904' '--tags=task_name:peach_pit-tot-chrome-pfq-informational/R63-9965.0.0-b7904-bvt-arc' '--tags=board:peach_pit' -- /usr/local/autotest/site_utils/run_suite.py --build peach_pit-tot-chrome-pfq-informational/R63-9965.0.0-b7904 --board peach_pit --suite_name bvt-arc --pool continuous --num 6 --file_bugs True --priority PFQ --timeout_mins 180 --retry False --minimum_duts 4 --offload_failures_only False --job_keyvals "{'cidb_build_stage_id': 56846793L, 'cidb_build_id': 1875690, 'datastore_parent_key': ('Build', 1875690, 'BuildStage', 56846793L)}" -c
Priority was reset to 100
Triggered task: peach_pit-tot-chrome-pfq-informational/R63-9965.0.0-b7904-bvt-arc
Waiting for results from the following shards: 0
Waiting for results from the following shards: 0
chromeos-golo-server2-215: 38c3e4563a629e10 1
  Autotest instance created: cautotest-prod
  Traceback (most recent call last):
    File "/usr/local/autotest/site_utils/run_suite.py", line 2066, in <module>
      sys.exit(main())
    File "/usr/local/autotest/site_utils/run_suite.py", line 2049, in main
      result = _run_task(options)
    File "/usr/local/autotest/site_utils/run_suite.py", line 1986, in _run_task
      return _run_suite(options)
    File "/usr/local/autotest/site_utils/run_suite.py", line 1731, in _run_suite
      options.skip_duts_check)
    File "/usr/local/autotest/site_utils/diagnosis_utils.py", line 306, in check_dut_availability
      multiple_labels=('pool:%s' % pool, 'board:%s' % board))
    File "/usr/local/autotest/server/frontend.py", line 527, in get_hosts
      hosts = self.run('get_hosts', **query_args)
    File "/usr/local/autotest/server/cros/dynamic_suite/frontend_wrappers.py", line 126, in run
      self, call, **dargs)
    File "/usr/local/autotest/site-packages/chromite/lib/retry_util.py", line 243, in GenericRetry
      return _run()
    File "/usr/local/autotest/site-packages/chromite/lib/retry_util.py", line 170, in _Wrapper
      self._retry_delay.Sleep(attempt)
    File "/usr/local/autotest/site-packages/chromite/lib/retry_util.py", line 66, in Sleep
      time.sleep(total)
    File "/usr/local/autotest/site-packages/chromite/lib/timeout_util.py", line 87, in kill_us
      raise TimeoutError(error_message % {'time': max_run_time})
  chromite.lib.timeout_util.TimeoutError: Timeout occurred- waited 1800.0 seconds.

Infra issue?
 

Comment 1 by x...@chromium.org, Sep 25 2017

Status: Fixed (was: Available)
Lab failure. Restarting has fixed the problem. Close it. 

Comment 2 by dchan@chromium.org, Jan 22 2018

Status: Archived (was: Fixed)

Comment 3 by dchan@chromium.org, Jan 23 2018

Status: Fixed (was: Archived)

Sign in to add a comment