New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 662844 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
Last visit > 30 days ago
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 3
Type: Bug



Sign in to add a comment

factory: partner friendly bundle creation

Project Member Reported by hungte@chromium.org, Nov 7 2016

Issue description

Currently the bundle is bloated and hard to maintain for a release process, either initiated by Google or partners. Listing things we have to fix:

 - Reduce bundle size. Prevent the duplication of static/ folder.
 - Minimize bundle creation time. Finalize_bundle should not do unnecessary task.
   - Bonus if the buildbot can generate a full bundle directly.
 - Make Umpire easier to parse and import a bundle.

Targets (back of the envelope calculation):
  A bundle should be not larger than its contents. x86 images (compressed) have
    600M release image
    800M test image
    150M factory install image
    Minor stuff (fw, netboot fw, netboot kern, completion script, hwid, setup scripts, ...)
  So a bundle (compressed) should be less than 2G.

  (Umpire, Dome and docker images are not included).

  Upload time (assume 100MBit/s) = 163s, i.e., < 3min
  Processing time = Extract, calculate hash, ... should be no longer than double of upload time - probably 6min.

 

Comment 1 by hungte@chromium.org, Jan 25 2017

Owner: pihsun@chromium.org
Status: Assigned (was: Untriaged)
Temporarily assign to pihsun. Let me know if you have some ideas on this, thanks!
Cc: phoenixshen@chromium.org
Owner: phoenixshen@chromium.org
Re-assigned to phoenixshen.
Cc: marcochen@chromium.org
+marco

Hi marco, you can also help on this if you're interested.
I totally missed this issue and sorry about it.
Project Member

Comment 5 by bugdroid1@chromium.org, Nov 27

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/factory/+/41f6327bbe03af1ad1a2e7627d2adca17b7e7531

commit 41f6327bbe03af1ad1a2e7627d2adca17b7e7531
Author: Ting Shen <phoenixshen@google.com>
Date: Tue Nov 27 23:19:52 2018

Protorpc service for bundle creation

(originally CL:725065)
This CL implements
1) A protorpc service which accepts a request message
   similiar to manifest.yaml, and push the request to a
   compute engine worker to process.

2) A worker to process the request.

BUG=chromium:662844
TEST=manually

Change-Id: I501d6fb0ef361675f3327ef69b8e1eb46e31fe3d
Reviewed-on: https://chromium-review.googlesource.com/1116637
Commit-Ready: ChromeOS CL Exonerator Bot <chromiumos-cl-exonerator@appspot.gserviceaccount.com>
Tested-by: Wei-Han Chen <stimim@chromium.org>
Reviewed-by: Wei-Han Chen <stimim@chromium.org>

[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/app_engine/app.yaml
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/docker/util.py
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/app_engine/rpc/cloud-init.yaml
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/docker/Dockerfile
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/docker/worker.py
[modify] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/tools/deps.conf
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/docker/factory_common.py
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/docker/__init__.py
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/proto/factorybundle.proto
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/app_engine/queue.yaml
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/__init__.py
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/app_engine/__init__.py
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/app_engine/appengine_config.py
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/docker/requirements.txt
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/app_engine/requirements.txt
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/app_engine/rpc/__init__.py
[add] https://crrev.com/41f6327bbe03af1ad1a2e7627d2adca17b7e7531/py/bundle_creator/app_engine/rpc/stubby.py

Sign in to add a comment