New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 853962 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Jun 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

platform_InstallTestImage is failing with different reasons.

Project Member Reported by dsunk...@chromium.org, Jun 18 2018

Issue description

Schedule platform_InstallTestImage Test using cautotest. The test either fails or gets into the queue and then gets aborted due to timeout. The test does not run even though host is available. 

Failure reasons:

1. object has no attribute '_get_cros_repair_image_name'
https://ubercautotest.corp.google.com/afe/#tab_id=view_job&object_id=209598029

2. DevServerException: stage_artifacts timed out: build=veyron_minnie-release/R66-10359.0.0, artifacts=['autotest_packages'], files=, archive_url=gs://chromeos-image-archive/veyron_minnie-release/R66-10359.0.0
https://ubercautotest.corp.google.com/afe/#tab_id=view_job&object_id=209570957

3. Queued, but not running:
https://ubercautotest.corp.google.com/afe/#tab_id=view_job&object_id=209598269

Can you please take a look at this issue?



 
Log traces for above mentioned errors:
1.
06/18 13:43:54.331 DEBUG|             utils:0215| Running 'ssh 100.115.127.245 'curl "http://100.115.127.245:8082/is_staged?artifacts=full_payload&files=&archive_url=gs://chromeos-image-archive/beaglebone_servo-release/R69-10738.0.0"''
06/18 13:44:02.831 DEBUG|        dev_server:1142| whether artifact is staged: 'True'
06/18 13:44:02.832 INFO |        dev_server:1262| Finished staging artifacts: build=beaglebone_servo-release/R69-10738.0.0, artifacts=['full_payload'], files=, archive_url=gs://chromeos-image-archive/beaglebone_servo-release/R69-10738.0.0
06/18 13:44:02.846 DEBUG|          ssh_host:0301| Running (ssh) 'touch /home/chronos/.oobe_completed' from '_verify_host|verify|update_image|run|run|run_very_slowly'
06/18 13:44:03.396 DEBUG|          ssh_host:0301| Running (ssh) '/usr/bin/update_engine_client -status | grep CURRENT_OP' from '_Wrapper|_run|check_update_status|run|run|run_very_slowly'
06/18 13:44:03.967 ERROR|             utils:0283| [stderr] [0618/193414:INFO:update_engine_client.cc(508)] Querying Update Engine status...
06/18 13:44:03.982 DEBUG|             utils:0283| [stdout] CURRENT_OP=UPDATE_STATUS_IDLE
06/18 13:44:03.989 INFO |       autoupdater:0479| Triggering update via: /usr/bin/update_engine_client --check_for_update --omaha_url=http://100.115.127.245:8082/update/beaglebone_servo-release/R69-10738.0.0
06/18 13:44:04.003 DEBUG|          ssh_host:0301| Running (ssh) '/usr/bin/update_engine_client --check_for_update --omaha_url=http://100.115.127.245:8082/update/beaglebone_servo-release/R69-10738.0.0' from '_Wrapper|_run|_base_update_handler_no_retry|run|run|run_very_slowly'
06/18 13:44:04.568 ERROR|             utils:0283| [stderr] [0618/193414:INFO:update_engine_client.cc(488)] Initiating update check and install.
06/18 13:44:04.610 DEBUG|          ssh_host:0301| Running (ssh) '/usr/bin/update_engine_client -status | grep CURRENT_OP' from 'verify|update_image|check_update_status|run|run|run_very_slowly'
06/18 13:44:05.177 ERROR|             utils:0283| [stderr] [0618/193415:INFO:update_engine_client.cc(508)] Querying Update Engine status...
06/18 13:44:05.493 DEBUG|             utils:0283| [stdout] CURRENT_OP=UPDATE_STATUS_CHECKING_FOR_UPDATE
06/18 13:44:05.504 INFO |        servo_host:0584| Triggered download and update passed for chromeos15-row1-rack4-host4-servo, update engine currently in status UPDATE_STATUS_CHECKING_FOR_UPDATE
06/18 13:44:05.505 INFO |            repair:0349| Verifying this condition: All host verification checks pass
06/18 13:44:05.937 ERROR|        server_job:0813| Exception escaped control file, job aborting:
Traceback (most recent call last):
  File "/usr/local/autotest/server/server_job.py", line 805, in run
    self._execute_code(server_control_file, namespace)
  File "/usr/local/autotest/server/server_job.py", line 1328, in _execute_code
    execfile(code_file, namespace, namespace)
  File "/usr/local/autotest/results/209598029-dsunkara/chromeos15-row1-rack4-host4/control.srv", line 77, in <module>
    step_init()
  File "/usr/local/autotest/results/209598029-dsunkara/chromeos15-row1-rack4-host4/control.srv", line 2, in step_init
    step0()
  File "/usr/local/autotest/results/209598029-dsunkara/chromeos15-row1-rack4-host4/control.srv", line 75, in step0
    parallel_simple(run, machines)
  File "/usr/local/autotest/server/subcommand.py", line 98, in parallel_simple
    function(arg)
  File "/usr/local/autotest/results/209598029-dsunkara/chromeos15-row1-rack4-host4/control.srv", line 60, in run
    image_name = host._get_cros_repair_image_name()
AttributeError: 'chromeos15-row1-rack4-host4_host' object has no attribute '_get_cros_repair_image_name'
06/18 13:44:05.938 INFO |        server_job:0218| INFO	----	----	timestamp=1529354645	job_abort_reason='chromeos15-row1-rack4-host4_host' object has no attribute '_get_cros_repair_image_name'	localtime=Jun 18 13:44:05	'chromeos15-row1-rack4-host4_host' object has no attribute '_get_cros_repair_image_name'
06/18 13:44:05.939 ERROR|   logging_manager:0626| tko parser: {'drone': 'chromeos-skunk-4.mtv.corp.google.com', 'job_queued': 1529354201, 'job_started': 1529354564, 'user': 'dsunkara', 'hostname': 'chromeos15-row1-rack4-host4', 'status_version': 1, 'label': 'chromeos15-row1-rack4-host4.platform_installTestImage'}
06/18 13:44:05.940 ERROR|   logging_manager:0626| tko parser: MACHINE NAME: chromeos15-row1-rack4-host4


2.
06/18 12:38:15.399 ERROR|         traceback:0013| Traceback (most recent call last):
06/18 12:38:15.400 ERROR|         traceback:0013|   File "/usr/local/autotest/server/autoserv", line 603, in run_autoserv
06/18 12:38:15.400 ERROR|         traceback:0013|     use_packaging=(not no_use_packaging))
06/18 12:38:15.400 ERROR|         traceback:0013|   File "/usr/local/autotest/server/server_job.py", line 777, in run
06/18 12:38:15.400 ERROR|         traceback:0013|     namespace)
06/18 12:38:15.401 ERROR|         traceback:0013|   File "/usr/local/autotest/server/server_job.py", line 1328, in _execute_code
06/18 12:38:15.401 ERROR|         traceback:0013|     execfile(code_file, namespace, namespace)
06/18 12:38:15.401 ERROR|         traceback:0013|   File "/usr/local/autotest/server/control_segments/verify_job_repo_url", line 10, in <module>
06/18 12:38:15.401 ERROR|         traceback:0013|     job.parallel_simple(install, machines, log=False)
06/18 12:38:15.401 ERROR|         traceback:0013|   File "/usr/local/autotest/server/server_job.py", line 613, in parallel_simple
06/18 12:38:15.401 ERROR|         traceback:0013|     log=log, timeout=timeout, return_results=return_results)
06/18 12:38:15.401 ERROR|         traceback:0013|   File "/usr/local/autotest/server/subcommand.py", line 98, in parallel_simple
06/18 12:38:15.402 ERROR|         traceback:0013|     function(arg)
06/18 12:38:15.402 ERROR|         traceback:0013|   File "/usr/local/autotest/server/control_segments/verify_job_repo_url", line 7, in install
06/18 12:38:15.402 ERROR|         traceback:0013|     host.verify_job_repo_url(job.tag)
06/18 12:38:15.402 ERROR|         traceback:0013|   File "/usr/local/autotest/server/hosts/cros_host.py", line 382, in verify_job_repo_url
06/18 12:38:15.403 ERROR|         traceback:0013|     ds.stage_artifacts(image_name, ['autotest_packages'])
06/18 12:38:15.403 ERROR|         traceback:0013|   File "/usr/local/autotest/client/common_lib/cros/dev_server.py", line 376, in metrics_wrapper
06/18 12:38:15.403 ERROR|         traceback:0013|     return wrapper()
06/18 12:38:15.403 ERROR|         traceback:0013|   File "/usr/local/autotest/client/common_lib/cros/retry.py", line 218, in func_retry
06/18 12:38:15.403 ERROR|         traceback:0013|     remaining_time)
06/18 12:38:15.403 ERROR|         traceback:0013|   File "/usr/local/autotest/client/common_lib/cros/retry.py", line 123, in timeout
06/18 12:38:15.403 ERROR|         traceback:0013|     default_result = func(*args, **kwargs)
06/18 12:38:15.404 ERROR|         traceback:0013|   File "/usr/local/autotest/client/common_lib/cros/dev_server.py", line 370, in wrapper
06/18 12:38:15.404 ERROR|         traceback:0013|     return method(*args, **kwargs)
06/18 12:38:15.404 ERROR|         traceback:0013|   File "/usr/local/autotest/client/common_lib/cros/dev_server.py", line 1567, in stage_artifacts
06/18 12:38:15.404 ERROR|         traceback:0013|     self._stage_artifacts(image, artifacts, files, archive_url)
06/18 12:38:15.404 ERROR|         traceback:0013|   File "/usr/local/autotest/client/common_lib/cros/dev_server.py", line 1267, in _stage_artifacts
06/18 12:38:15.404 ERROR|         traceback:0013|     'stage_artifacts timed out: %s' % staging_info)
06/18 12:38:15.404 ERROR|         traceback:0013| DevServerException: stage_artifacts timed out: build=veyron_minnie-release/R66-10359.0.0, artifacts=['autotest_packages'], files=, archive_url=gs://chromeos-image-archive/veyron_minnie-release/R66-10359.0.0
06/18 12:38:15.418 INFO |            client:0570| Attempting refresh to obtain initial access_token
06/18 12:38:15.463 INFO |            client:0872| Refreshing access_token
06/18 12:38:15.932 ERROR|          autoserv:0809| Uncaught SystemExit with code 1
Traceback (most recent call last):
  File "/usr/local/autotest/server/autoserv", line 805, in main
    use_ssp)
  File "/usr/local/autotest/server/autoserv", line 627, in run_autoserv
    sys.exit(exit_code)
SystemExit: 1
06/18 12:38:16.051 DEBUG|   logging_manager:0627| Logging subprocess finished
06/18 12:38:16.051 DEBUG|   logging_manager:0627| Logging subprocess finished
Labels: OS-Chrome
Owner: jrbarnette@chromium.org
Status: Available (was: Untriaged)
jrbarnette@ - are you the right person to help take a look at this? Thanks
Components: -Infra
Owner: ----
> Failure reasons:
>
> 1. object has no attribute '_get_cros_repair_image_name'
> https://ubercautotest.corp.google.com/afe/#tab_id=view_job&object_id=209598029
> 
> 2. DevServerException: stage_artifacts timed out: build=veyron_minnie-release/R66-10359.0.0, artifacts=['autotest_packages'], files=, archive_url=gs://chromeos-image-archive/veyron_minnie-release/R66-10359.0.0
> https://ubercautotest.corp.google.com/afe/#tab_id=view_job&object_id=209570957
> 
> 3. Queued, but not running:
> https://ubercautotest.corp.google.com/afe/#tab_id=view_job&object_id=209598269

These are three separate bugs, and should have three separate reports.

Regarding this item:

> 1. object has no attribute '_get_cros_repair_image_name'

The test was broken by this change:
    https://chromium-review.googlesource.com/424795

That change made the control file dependent on a private method
in CrosHost.  That method, being private, was never meant to be
used outside of the class, and has since been deleted (because,
being private, there shouldn't have been outside dependencies).
The correct function to use is `CrosHost.get_cros_repair_image_name()`.

Dropping ownership; these aren't my bugs to fix.

Comment 4 by jkop@chromium.org, Jun 19 2018

Status: WontFix (was: Available)
Closing to be replaced by other bugs.

Sign in to add a comment