New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 713946 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: May 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

"<DUT> is not in an installable state" error in autoupdate_EndToEndTest in canaries

Project Member Reported by semenzato@chromium.org, Apr 21 2017

Issue description

I haven't seen this one before!

Seems to happen mostly on veyron_rialto.  Search crbug.com for the string "is not in an installable state" (with the quotes).

https://uberchromegw.corp.google.com/i/chromeos/builders/veyron_rialto-release/builds/1049

https://pantheon.corp.google.com/storage/browser/chromeos-autotest-results/113559823-chromeos-test/chromeos2-row1-rack10-host5/debug/

autoserv.DEBUG:

04/20 16:21:24.528 DEBUG|          ssh_host:0284| Running (ssh) '/usr/bin/update_engine_client -status | grep CURRENT_OP'
04/20 16:21:24.768 ERROR|        base_utils:0280| [stderr] [0420/162124:INFO:update_engine_client.cc(493)] Querying Update Engine status...
04/20 16:21:24.772 DEBUG|        base_utils:0280| [stdout] CURRENT_OP=UPDATE_STATUS_CHECKING_FOR_UPDATE
04/20 16:21:24.773 DEBUG|              test:0389| Test failed due to chromeos2-row1-rack10-host5 is not in an installable state. Exception log follows the after_iteration_hooks.
04/20 16:21:24.773 DEBUG|              test:0392| starting after_iteration_hooks

 
Also seen in  issue 588828 .

Comment 2 Deleted

Comment 3 by nxia@chromium.org, Apr 21 2017

The reset job failed:

 2017-04-20 15:25:53  -- http://cautotest/tko/retrieve_logs.cgi?job=/results/hosts/chromeos2-row1-rack10-host5/605666-reset/



04/20 15:26:07.934 DEBUG|            repair:0108|     Python on the host is installed and working
04/20 15:26:07.934 ERROR|             reset:0037| Python is missing; may be caused by powerwash
Traceback (most recent call last):
  File "/usr/local/autotest/server/control_segments/reset", line 33, in reset
    target.verify()
  File "/usr/local/autotest/server/hosts/cros_host.py", line 1516, in verify
    self._repair_strategy.verify(self)
  File "/usr/local/autotest/client/common_lib/hosts/repair.py", line 685, in verify
    self._verify_root._verify_host(host, silent)
  File "/usr/local/autotest/client/common_lib/hosts/repair.py", line 326, in _verify_host
    self._verify_dependencies(host, silent)
  File "/usr/local/autotest/client/common_lib/hosts/repair.py", line 199, in _verify_dependencies
    self._verify_list(host, self._dependency_list, silent)
  File "/usr/local/autotest/client/common_lib/hosts/repair.py", line 188, in _verify_list
    raise AutoservVerifyDependencyError(self, failures)
AutoservVerifyDependencyError: Python is missing; may be caused by powerwash
04/20 15:26:07.935 INFO |        server_job:0184| END FAIL	----	reset	timestamp=1492727167	localtime=Apr 20 15:26:07	
04/20 15:26:07.935 DEBUG|      abstract_ssh:0756| Nuking master_ssh_job.
04/20 15:26:08.940 DEBUG|      abstract_ssh:0762| Cleaning master_ssh_tempdir.
04/20 15:26:08.940 ERROR|         traceback:0013| Traceback (most recent call last):
04/20 15:26:08.941 ERROR|         traceback:0013|   File "/usr/local/autotest/server/autoserv", line 520, in run_autoserv
04/20 15:26:08.941 ERROR|         traceback:0013|     job.reset(job_labels)
04/20 15:26:08.941 ERROR|         traceback:0013|   File "/usr/local/autotest/server/server_job.py", line 501, in reset
04/20 15:26:08.941 ERROR|         traceback:0013|     self._execute_code(RESET_CONTROL_FILE, namespace, protect=False)
04/20 15:26:08.941 ERROR|         traceback:0013|   File "/usr/local/autotest/server/server_job.py", line 1301, in _execute_code
04/20 15:26:08.942 ERROR|         traceback:0013|     execfile(code_file, namespace, namespace)
04/20 15:26:08.942 ERROR|         traceback:0013|   File "/usr/local/autotest/server/control_segments/reset", line 48, in <module>
04/20 15:26:08.942 ERROR|         traceback:0013|     job.parallel_simple(reset, machines)
04/20 15:26:08.942 ERROR|         traceback:0013|   File "/usr/local/autotest/server/server_job.py", line 625, in parallel_simple
04/20 15:26:08.942 ERROR|         traceback:0013|     return_results=return_results)
04/20 15:26:08.942 ERROR|         traceback:0013|   File "/usr/local/autotest/server/subcommand.py", line 93, in parallel_simple
04/20 15:26:08.943 ERROR|         traceback:0013|     function(arg)
04/20 15:26:08.943 ERROR|         traceback:0013|   File "/usr/local/autotest/server/control_segments/reset", line 41, in reset
04/20 15:26:08.943 ERROR|         traceback:0013|     raise Exception('')
04/20 15:26:08.943 ERROR|         traceback:0013| Exception
04/20 15:26:08.946 INFO |            client:0570| Attempting refresh to obtain initial access_token
04/20 15:26:08.983 INFO |            client:0872| Refreshing access_token
04/20 15:26:09.280 ERROR|          autoserv:0765| 1


Comment 4 by nxia@chromium.org, Apr 21 2017

Cc: jrbarnette@chromium.org shuqianz@chromium.org
But this only happened once today and other other reset job on that dut worked well. Can this be a flake?

Comment 5 by aut...@google.com, May 16 2017

Status: WontFix (was: Untriaged)
Moving to "won't fix" for now, please re-open if other examples arise. 

Sign in to add a comment