New issue
Advanced search Search tips

Issue 875068 link

Starred by 2 users

Issue metadata

Status: Fixed
Owner:
Closed: Aug 24
Cc:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

cros flash fails with not finding cros_generate_update_payload

Project Member Reported by ahass...@chromium.org, Aug 16

Issue description

(cr) ((049be4cd...)) ahassani@ahassani ~/trunk/src/third_party/portage-stable $ cros flash --debug 100.90.29.208 veyron_minnie/latest/test                                                                                                                                                                                    
14:29:03: DEBUG: Cache dir lookup.                                                                                                                                                                                                                                                                                            
14:29:03: DEBUG: Configured cache_dir to '/mnt/host/source/.cache'                                                                                                                                                                                                                                                            
14:29:03: NOTICE: Preparing to update the remote device 100.90.29.208                                                                                                                                                                                                                                                         
14:29:03: INFO: RunCommand: ping -c 1 -w 20 100.90.29.208                                                                                                                                                                                                                                                                     
14:29:03: DEBUG: RunCommand: ssh -p 22 '-oConnectionAttempts=4' '-oUserKnownHostsFile=/dev/null' '-oProtocol=2' '-oConnectTimeout=30' '-oServerAliveCountMax=3' '-oStrictHostKeyChecking=no' '-oServerAliveInterval=10' '-oNumberOfPasswordPrompts=0' '-oIdentitiesOnly=yes' -i /tmp/ssh-tmpib9RzW/testing_rsa root@100.90.29.
208 -- cat /etc/lsb-release                                                                                                                                                                                                                                                                                                   
14:29:04: INFO: Board is veyron_minnie                                                                                                                                                                                                                                                                                        
14:29:04: INFO: [16/Aug/2018:14:29:04] XBUDDY Using shadow config file stored at /mnt/host/source/src/platform/dev/shadow_xbuddy_config.ini                                                                                                                                                                                   
14:29:04: DEBUG: Assuming veyron_minnie/latest/test is an xbuddy path.                                                                                                                                                                                                                                                        
14:29:04: INFO: [16/Aug/2018:14:29:04] XBUDDY Linking to /mnt/host/source/devserver/static/veyron_minnie/R70-10945.0.2018_08_09_1737-a1 from /mnt/host/source/src/build/images/veyron_minnie/R70-10945.0.2018_08_09_1737-a1                                                                                                   
14:29:04: INFO: [16/Aug/2018:14:29:04] XBUDDY Path is veyron_minnie/latest/test, location suffix is -release                                                                                                                                                                                                                  
14:29:04: INFO: [16/Aug/2018:14:29:04] XBUDDY Get artifact 'test' with board veyron_minnie and version latest'. Locally? True                                                                                                                                                                                                 
14:29:04: INFO: [16/Aug/2018:14:29:04] XBUDDY Returning path to payload: veyron_minnie/R70-10945.0.2018_08_09_1737-a1/chromiumos_test_image.bin                                                                                                                                                                               
14:29:04: INFO: [16/Aug/2018:14:29:04] XBUDDY Path is veyron_minnie/latest/test, location suffix is -release                                                                                                                                                                                                                  
14:29:04: NOTICE: Using image veyron_minnie/R70-10945.0.2018_08_09_1737-a1/chromiumos_test_image.bin                                                                                                                                                                                                                          
14:29:04: DEBUG: Assuming veyron_minnie/latest/test is an xbuddy path.                                                                                                                                                                                                                                                        
14:29:04: DEBUG: Assuming local/veyron_minnie/R70-10945.0.2018_08_09_1737-a1/test is an xbuddy path.                                                                                                                                                                                                                          
14:29:04: INFO: Starting local devserver to generate/serve payloads...                                                                                                                                                                                                                                                        
14:29:04: INFO: /mnt/host/source/.cache/common/gsutil_4.33.tar.gz/gsutil:/usr/local/bin:/usr/bin:/bin:/opt/bin:/usr/x86_64-pc-linux-gnu/gcc-bin/4.9.x:/usr/x86_64-pc-linux-gnu/arm-none-eabi/gcc-bin/4.9.x:/usr/x86_64-pc-linux-gnu/armv7a-cros-linux-gnueabi/gcc-bin/4.9.x:/usr/x86_64-pc-linux-gnu/armv7a-cros-linux-gnueabi
hf/gcc-bin/4.9.x:/usr/x86_64-pc-linux-gnu/x86_64-cros-linux-gnu/gcc-bin/4.9.x:/mnt/host/source/chromite/bin:/mnt/host/depot_tools                                                                                                                                                                                             
14:29:04: DEBUG: RunCommand: sudo 'CROS_CACHEDIR=/mnt/host/source/.cache' -- start_devserver --pidfile /tmp/devserver_wrapperxwkl2L/devserver_wrapper2j5geB --logfile /tmp/devserver_wrapperxwkl2L/dev_server.log '--port=0' --critical_update '--portfile=/tmp/devserver_wrapperxwkl2L/dev_server.port' '--static_dir=/mnt/ho
st/source/devserver/static' '--board=veyron_minnie' in /mnt/host/source                                                                                                                                                                                                                                                       
14:29:09: DEBUG: Retrieving http://127.0.0.1:43189/check_health                                                                                                                                                                                                                                                               
14:29:09: DEBUG: Retrieving http://100.99.132.43:43189/xbuddy/local/veyron_minnie/R70-10945.0.2018_08_09_1737-a1/test?for_update=true&return_dir=true                                                                                                                                                                         
14:29:19: ERROR: Devserver responded with HTTP error (HTTP Error 500: Internal Server Error)                                                                                                                                                                                                                                  
14:29:19: DEBUG: RunCommand: sudo 'CROS_CACHEDIR=/mnt/host/source/.cache' -- test -f /tmp/devserver_wrapperxwkl2L/dev_server.log                                                                                                                                                                                              
14:29:19: DEBUG: RunCommand: sudo 'CROS_CACHEDIR=/mnt/host/source/.cache' -- tail -n 50 /tmp/devserver_wrapperxwkl2L/dev_server.log                                                                                                                                                                                           
14:29:19: WARNING: --- Start output from /tmp/devserver_wrapperxwkl2L/dev_server.log ---[16/Aug/2018:14:29:09] XBUDDY Downloading ['full_payload', 'stateful'] from gs://chromeos-image-archive/veyron_minnie/R70-10945.0.2018_08_09_1737-a1                                                                                  
[16/Aug/2018:14:29:09] GOOGLE_STORAGE_DOWNLOADER Downloading artifacts *_full_*->/mnt/host/source/devserver/static/veyron_minnie/R70-10945.0.2018_08_09_1737-a1 stateful.tgz->/mnt/host/source/devserver/static/veyron_minnie/R70-10945.0.2018_08_09_1737-a1.                                                                 
[16/Aug/2018:14:29:09] A_U_TEST_PAYLOAD No marker file, *_full_*->/mnt/host/source/devserver/static/veyron_minnie/R70-10945.0.2018_08_09_1737-a1 is not staged.                                                                                                                                                               
[16/Aug/2018:14:29:10] XBUDDY Linking to /mnt/host/source/devserver/static/veyron_minnie/R70-10945.0.2018_08_09_1737-a1 from /mnt/host/source/src/build/images/veyron_minnie/R70-10945.0.2018_08_09_1737-a1                                                                                                                   
[16/Aug/2018:14:29:10] XBUDDY Path is local/veyron_minnie/R70-10945.0.2018_08_09_1737-a1/test, location suffix is -release                                                                                                                                                                                                    
[16/Aug/2018:14:29:10] XBUDDY Get artifact 'test' with board veyron_minnie and version R70-10945.0.2018_08_09_1737-a1'. Locally? True                                                                                                                                                                                         
[16/Aug/2018:14:29:10] XBUDDY Updating timestamp for veyron_minnie/R70-10945.0.2018_08_09_1737-a1                                                                                                                                                                                                                             
[16/Aug/2018:14:29:10] XBUDDY Returning path to payload: veyron_minnie/R70-10945.0.2018_08_09_1737-a1/chromiumos_test_image.bin                                                                                                                                                                                               
[16/Aug/2018:14:29:10] DEVSERVER Payload generation triggered by request                                                                                                                                                                                                                                                      
[16/Aug/2018:14:29:10] UPDATE Update label/file: veyron_minnie/R70-10945.0.2018_08_09_1737-a1/chromiumos_test_image.bin                                                                                                                                                                                                       
[16/Aug/2018:14:29:10] UPDATE Generating update for src  image /mnt/host/source/devserver/static/veyron_minnie/R70-10945.0.2018_08_09_1737-a1/chromiumos_test_image.bin                                                                                                                                                       
[16/Aug/2018:14:29:19] UPDATE Caching in sub_dir "cache/8117e613541b3d3cc110116548be685c"                                                                                                                                                                                                                                     
[16/Aug/2018:14:29:19] UPDATE Generating update for image /mnt/host/source/devserver/static/veyron_minnie/R70-10945.0.2018_08_09_1737-a1/chromiumos_test_image.bin                                                                                                                                                            
[16/Aug/2018:14:29:19] UPDATE Generating update image /mnt/host/source/devserver/static/cache/8117e613541b3d3cc110116548be685c/update.gz                                                                                                                                                                                      
[16/Aug/2018:14:29:19] UPDATE Running cros_generate_update_payload --image /mnt/host/source/devserver/static/veyron_minnie/R70-10945.0.2018_08_09_1737-a1/chromiumos_test_image.bin --out_metadata_hash_file /mnt/host/source/devserver/static/cache/8117e613541b3d3cc110116548be685c/metadata_hash --output /mnt/host/source/
devserver/static/cache/8117e613541b3d3cc110116548be685c/update.gz                                                                                                                                                                                                                                                             
[16/Aug/2018:14:29:19] HTTP Traceback (most recent call last):                                                                                                                                                                                                                                                                
  File "/usr/lib64/python2.7/site-packages/cherrypy/_cprequest.py", line 656, in respond                                                                                                                                                                                                                                      
    response.body = self.handler()                                                                                                                                                                                                                                                                                            
  File "/usr/lib64/python2.7/site-packages/cherrypy/lib/encoding.py", line 188, in __call__                                                                                                                                                                                                                                   
    self.body = self.oldhandler(*args, **kwargs)                                                                                                                                                                                                                                                                              
  File "/usr/lib64/python2.7/site-packages/cherrypy/_cpdispatch.py", line 34, in __call__                                                                                                                                                                                                                                     
    return self.callable(*self.args, **self.kwargs)                                                                                                                                                                                                                                                                           
  File "/usr/lib/devserver/devserver.py", line 1520, in xbuddy                                                                                                                                                                                                                                                                
    image_name=file_name)                                                                                                                                                                                                                                                                                                     
  File "/usr/lib64/devserver/autoupdate.py", line 500, in GetUpdateForLabel                                                                                                                                                                                                                                                   
    rel_path = self.GenerateUpdateImageWithCache(static_image_path)                                                                                                                                                                                                                                                           
  File "/usr/lib64/devserver/autoupdate.py", line 433, in GenerateUpdateImageWithCache                                                                                                                                                                                                                                        
    self.GenerateUpdateImage(image_path, cache_dir)                                                                                                                                                                                                                                                                           
  File "/usr/lib64/devserver/autoupdate.py", line 395, in GenerateUpdateImage                                                                                                                                                                                                                                                 
    self.GenerateUpdateFile(self.src_image, image_path, output_dir)                                                                                                                                                                                                                                                           
  File "/usr/lib64/devserver/autoupdate.py", line 330, in GenerateUpdateFile                                                                                                                                                                                                                                                  
    subprocess.check_call(update_command)                                                                                                                                                                                                                                                                                     
  File "/usr/lib64/python2.7/subprocess.py", line 535, in check_call                                                                                                                                                                                                                                                          
    retcode = call(*popenargs, **kwargs)                                                                                                                                                                                                                                                                                      
  File "/usr/lib64/python2.7/subprocess.py", line 522, in call                                                                                                                                                                                                                                                                
    return Popen(*popenargs, **kwargs).wait()                                                                                                                                                                                                                                                                                 
  File "/usr/lib64/python2.7/subprocess.py", line 710, in __init__                                                                                                                                                                                                                                                            
    errread, errwrite)                                                                                                                                                                                                                                                                                                        
  File "/usr/lib64/python2.7/subprocess.py", line 1335, in _execute_child                                                                                                                                                                                                                                                     
    raise child_exception                                                                                                                                                                                                                                                                                                     
OSError: [Errno 2] No such file or directory                                                                                                                                                                                                                                                                                  
                                                                                                                                                                                                                                                                                                                              
[16/Aug/2018:14:29:19] HTTP                                                                                                                                                                                                                                                                                                   
Request Headers:                                                                                                                                                                                                                                                                                                              
  HOST: 100.99.132.43:43189                                                                                                                                                                                                                                                                                                   
  CONNECTION: close                                                                                                                                                                                                                                                                                                           
  Remote-Addr: ::ffff:100.99.132.43                                                                                                                                                                                                                                                                                           
  USER-AGENT: Python-urllib/2.7                                                                                                                                                                                                                                                                                               
  ACCEPT-ENCODING: identity                                                                                                                                                                                                                                                                                                   
::ffff:100.99.132.43 - - [16/Aug/2018:14:29:19] "GET /xbuddy/local/veyron_minnie/R70-10945.0.2018_08_09_1737-a1/test?for_update=true&return_dir=true HTTP/1.1" 500 2338 "" "Python-urllib/2.7"                                                                                                                                
--- End output from /tmp/devserver_wrapperxwkl2L/dev_server.log ---                                                                                                                                                                                                                                                           
14:29:19: DEBUG: Stopping devserver instance with pid 18145                                                                                                                                                                                                                                                                   
14:29:19: DEBUG: RunCommand: sudo 'CROS_CACHEDIR=/mnt/host/source/.cache' -- kill 18145                                                                                                                                                                                                                                       
14:29:20: ERROR: Device update failed.   
 
Reverting https://chromium-review.googlesource.com/c/chromiumos/overlays/chromiumos-overlay/+/1173085 helps.

This worked for me:

$ git revert 9b1d54d048bb8eba44cf0af565f734214f35e8d0
$ cros_workon --host start cros-devutils
$ sudo emerge cros-devutils
I'm reverting the cause by reverting https://chromium-review.googlesource.com/c/chromiumos/overlays/chromiumos-overlay/+/1173085, 

it should fix it for now.

You could check with the sheriffs, it might be worth chumping the revert. Although I'm not sure if chumping works as expected for -9999 ebuilds, presumably the CQ needs to run to uprev the ebuild?
Summary: cros flash fails with not finding cros_generate_update_payload (was: cros flash fails)
Project Member

Comment 5 by bugdroid1@chromium.org, Aug 17

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/5d16bfabefb03fe9de78ce98c28bb963d30af6c7

commit 5d16bfabefb03fe9de78ce98c28bb963d30af6c7
Author: Amin Hassani <ahassani@chromium.org>
Date: Fri Aug 17 18:18:08 2018

Revert "Reland "cros-devutils: Remove cros_generate_update_payload from ebuild""

This reverts commit 9b1d54d048bb8eba44cf0af565f734214f35e8d0.

Reason for revert: <It broke cros flash>

Original change's description:
> Reland "cros-devutils: Remove cros_generate_update_payload from ebuild"
>
> This reverts commit ad7acbeee774e7e45aa8531a631c363f4bac17ed.
>
> This patch basically removes the bash cros_generate_update_payload from
> being installed in favor of the chromitized version of it. The chromitized
> version is already being used. This patch removes any use case of the bash
> version entirely.
>
> Reason for revert: <Fixed the root cause in CL:1174952>
>
> BUG=chromium:869691
> BUG= chromium:860072 
> TEST=tryjob
> CQ-DEPEND=CL:1174952
>
> Change-Id: I1b73fa790877125198c917490ba30edfe765e773
> Reviewed-on: https://chromium-review.googlesource.com/1173085
> Commit-Ready: Amin Hassani <ahassani@chromium.org>
> Tested-by: Amin Hassani <ahassani@chromium.org>
> Reviewed-by: Mike Frysinger <vapier@chromium.org>

BUG= chromium:875068 

Change-Id: I9ea303fd13ad7a629fb3cfa285d8bbd1fa726287
Reviewed-on: https://chromium-review.googlesource.com/1178942
Commit-Ready: Amin Hassani <ahassani@chromium.org>
Tested-by: Amin Hassani <ahassani@chromium.org>
Reviewed-by: Amin Hassani <ahassani@chromium.org>

[modify] https://crrev.com/5d16bfabefb03fe9de78ce98c28bb963d30af6c7/chromeos-base/cros-devutils/cros-devutils-9999.ebuild

Fixed?
Status: Fixed (was: Started)

Sign in to add a comment