New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 898618 link

Starred by 1 user

Issue metadata

Status: Closed
Owner:
Closed: Oct 29
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

wizpig-paladin: HWTest provision could not install stateful_update on DUT

Project Member Reported by benzh@chromium.org, Oct 24

Issue description

https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8931767529985337792

************************************************************
** Start Stage HWTest [bvt-tast-cq] - Wed, 24 Oct 2018 11:31:11 -0700 (PDT)
** 
** Stage that runs tests in the Autotest lab.
************************************************************
11:31:11: INFO: Created cidb engine bot@130.211.191.11 for pid 1393
11:31:11: INFO: Running cidb query on pid 1393, repr(query) starts with <sqlalchemy.sql.expression.Update object at 0x7fd85d6c2f90>
11:31:11: INFO: Waiting up to forever for payloads and test artifacts ...
Preconditions for the stage successfully met. Beginning to execute stage...
11:31:11: INFO: Running cidb query on pid 1393, repr(query) starts with <sqlalchemy.sql.expression.Update object at 0x7fd85d6fff90>
11:31:11: INFO: Re-run swarming_cmd to avoid buildbot salency check.
11:31:11: INFO: RunCommand: /b/swarming/w2z4K62/ir/cache/cbuild/repository/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /b/swarming/w2z4K62/ir/tmp/t/cbuildbot-tmpJSBVz7/tmpQgQztj/temp_summary.json --print-status-updates --timeout 9000 --raw-cmd --task-name wizpig-paladin/R72-11189.0.0-rc2-bvt-tast-cq --dimension os Ubuntu-14.04 --dimension pool default --io-timeout 9000 --hard-timeout 9000 --expiration 1200 '--tags=priority:CQ' '--tags=suite:bvt-tast-cq' '--tags=build:wizpig-paladin/R72-11189.0.0-rc2' '--tags=task_name:wizpig-paladin/R72-11189.0.0-rc2-bvt-tast-cq' '--tags=board:wizpig' -- /usr/local/autotest/site_utils/run_suite.py --build wizpig-paladin/R72-11189.0.0-rc2 --board wizpig --suite_name bvt-tast-cq --pool cq --file_bugs False --priority CQ --timeout_mins 90 --retry True --max_retries 5 --minimum_duts 1 --offload_failures_only False --job_keyvals "{'cidb_build_stage_id': 96902387L, 'cidb_build_id': 3068517, 'datastore_parent_key': ('Build', 3068517, 'BuildStage', 96902387L)}" --test_args "{'fast': 'True'}" -c
Autotest instance created: cautotest-prod
10-24-2018 [11:31:17] Submitted create_suite_job rpc
10-24-2018 [11:31:23] Created suite job: http://cautotest-prod/afe/#tab_id=view_job&object_id=251698131
--create_and_return was specified, terminating now.
Will return from run_suite with status: OK
11:31:24: INFO: Re-run swarming_cmd to avoid buildbot salency check.
11:31:24: INFO: RunCommand: /b/swarming/w2z4K62/ir/cache/cbuild/repository/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /b/swarming/w2z4K62/ir/tmp/t/cbuildbot-tmpJSBVz7/tmpv9eHrW/temp_summary.json --print-status-updates --timeout 9000 --raw-cmd --task-name wizpig-paladin/R72-11189.0.0-rc2-bvt-tast-cq --dimension os Ubuntu-14.04 --dimension pool default --io-timeout 9000 --hard-timeout 9000 --expiration 1200 '--tags=priority:CQ' '--tags=suite:bvt-tast-cq' '--tags=build:wizpig-paladin/R72-11189.0.0-rc2' '--tags=task_name:wizpig-paladin/R72-11189.0.0-rc2-bvt-tast-cq' '--tags=board:wizpig' -- /usr/local/autotest/site_utils/run_suite.py --build wizpig-paladin/R72-11189.0.0-rc2 --board wizpig --suite_name bvt-tast-cq --pool cq --file_bugs False --priority CQ --timeout_mins 90 --retry True --max_retries 5 --minimum_duts 1 --offload_failures_only False --job_keyvals "{'cidb_build_stage_id': 96902387L, 'cidb_build_id': 3068517, 'datastore_parent_key': ('Build', 3068517, 'BuildStage', 96902387L)}" --test_args "{'fast': 'True'}" -m 251698131
11:46:25: WARNING: Exception is not retriable return code: 3; command: /b/swarming/w2z4K62/ir/cache/cbuild/repository/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /b/swarming/w2z4K62/ir/tmp/t/cbuildbot-tmpJSBVz7/tmpv9eHrW/temp_summary.json --print-status-updates --timeout 9000 --raw-cmd --task-name wizpig-paladin/R72-11189.0.0-rc2-bvt-tast-cq --dimension os Ubuntu-14.04 --dimension pool default --io-timeout 9000 --hard-timeout 9000 --expiration 1200 '--tags=priority:CQ' '--tags=suite:bvt-tast-cq' '--tags=build:wizpig-paladin/R72-11189.0.0-rc2' '--tags=task_name:wizpig-paladin/R72-11189.0.0-rc2-bvt-tast-cq' '--tags=board:wizpig' -- /usr/local/autotest/site_utils/run_suite.py --build wizpig-paladin/R72-11189.0.0-rc2 --board wizpig --suite_name bvt-tast-cq --pool cq --file_bugs False --priority CQ --timeout_mins 90 --retry True --max_retries 5 --minimum_duts 1 --offload_failures_only False --job_keyvals "{'cidb_build_stage_id': 96902387L, 'cidb_build_id': 3068517, 'datastore_parent_key': ('Build', 3068517, 'BuildStage', 96902387L)}" --test_args "{'fast': 'True'}" -m 251698131
Triggered task: wizpig-paladin/R72-11189.0.0-rc2-bvt-tast-cq
Waiting for results from the following shards: 0
chromeos-golo-server2-84: 40c029ff030d2910 3
  Autotest instance created: cautotest-prod
  10-24-2018 [11:31:23] Created suite job: http://cautotest-prod/afe/#tab_id=view_job&object_id=251698131
  @@@STEP_LINK@Link to suite@http://cautotest-prod/afe/#tab_id=view_job&object_id=251698131@@@
  10-24-2018 [11:45:45] Suite job is finished.
  10-24-2018 [11:45:45] Start collecting test results and dump them to json.
  Suite job                             [ PASSED ]
  tast                                  [ PASSED ]
  tast.audio.DevicePlay                 [ PASSED ]
  tast.audio.DeviceRecord               [ PASSED ]
  tast.network.DefaultProfile           [ PASSED ]
  tast.platform.CheckProcesses          [ PASSED ]
  tast.platform.TPMResponsive           [ PASSED ]
  tast.power.CheckStatus                [ PASSED ]
  tast.security.LogPerms                [ PASSED ]
  tast.security.MountSymlink            [ PASSED ]
  tast.security.SELinuxProcessContext   [ PASSED ]
  tast.meta.ListTests                   [ PASSED ]
  tast.meta.RunTests                    [ PASSED ]
  tast.power.Reboot                     [ PASSED ]
  tast                                  [ PASSED ]
  tast.arc.Boot                         [ PASSED ]
  provision                             [ FAILED ]
  provision                               FAIL: Error on chromeos6-row2-rack20-host15 prior to update: Could not install stateful_update on DUT
  
  Suite timings:
  Downloads started at 2018-10-24 11:31:18
  Payload downloads ended at 2018-10-24 11:31:20
  Suite started at 2018-10-24 11:33:36
  Artifact downloads ended (at latest) at 2018-10-24 11:33:41
  Testing started at 2018-10-24 11:40:04
  Testing ended at 2018-10-24 11:42:22
 
Labels: Hotlist-Deputy
Owner: ayatane@chromium.org
Status: Assigned (was: Untriaged)
Grr, more devserver issues

10/24 11:41:13.619 DEBUG|          ssh_host:0310| Running (ssh) 'curl -o /tmp/stateful_update http://100.115.219.136:8082/static/stateful_update && head -1 /tmp/stateful_update | grep "^#!" | sed "s/#!//"' from '_reset_stateful_partition|_get_stateful_update_script|_get_remote_script|_run|run|run_very_slowly'
10/24 11:41:14.094 DEBUG|             utils:0287| [stderr] bash: /usr/bin/curl: Input/output error
10/2

Sitting on it for now
Status: Closed (was: Assigned)
Looks like this was a one-off failure.

Sign in to add a comment