New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 715790 link

Starred by 1 user

Issue metadata

Status: Archived
Owner:
Closed: Apr 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Feature



Sign in to add a comment

Turn on option to tar and zip up results directories

Project Member Reported by haddowk@chromium.org, Apr 26 2017

Issue description


Testing shows that for CTS and GTS upload bandwidth is reduced by 90% and the console and cts pipeline is not affected by this change.
 
Project Member

Comment 1 by bugdroid1@chromium.org, Apr 27 2017

Labels: merge-merged-release-R59-9460.B
The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/6998a0e6bdef7f4be5149f31580d12e31dc1f713

commit 6998a0e6bdef7f4be5149f31580d12e31dc1f713
Author: Keith Haddow <haddowk@chromium.org>
Date: Thu Apr 27 00:24:36 2017

[moblab] Turn on result file tar and compression

Partners have limited upload speeds, turn on the gs_offloader
option that tars and zips directories with more than 500 files.

This change affects moblab only.

BUG= chromium:715790 
TEST=manual testing on a moblab

Change-Id: I0417bdb0606f9a7e1bdb57105041c30807ff2469
Reviewed-on: https://chromium-review.googlesource.com/487736
Reviewed-by: Keith Haddow <haddowk@chromium.org>
Reviewed-by: Jinsong Mu <jinsong@google.com>
Commit-Queue: Keith Haddow <haddowk@chromium.org>
Tested-by: Keith Haddow <haddowk@chromium.org>

[modify] https://crrev.com/6998a0e6bdef7f4be5149f31580d12e31dc1f713/moblab_config.ini

Project Member

Comment 2 by bugdroid1@chromium.org, Apr 27 2017

Labels: merge-merged-release-R58-9334.B
The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/72dde64f0a93fb784808bb21ba25ee1fe4a7276b

commit 72dde64f0a93fb784808bb21ba25ee1fe4a7276b
Author: Keith Haddow <haddowk@chromium.org>
Date: Thu Apr 27 00:24:39 2017

[moblab] Turn on result file tar and compression

Partners have limited upload speeds, turn on the gs_offloader
option that tars and zips directories with more than 500 files.

This change affects moblab only.

BUG= chromium:715790 
TEST=manual testing on a moblab

Change-Id: I0417bdb0606f9a7e1bdb57105041c30807ff2469
Reviewed-on: https://chromium-review.googlesource.com/487735
Reviewed-by: Keith Haddow <haddowk@chromium.org>
Reviewed-by: Jinsong Mu <jinsong@google.com>
Commit-Queue: Keith Haddow <haddowk@chromium.org>
Tested-by: Keith Haddow <haddowk@chromium.org>
Trybot-Ready: Keith Haddow <haddowk@chromium.org>

[modify] https://crrev.com/72dde64f0a93fb784808bb21ba25ee1fe4a7276b/moblab_config.ini

Comment 3 by ihf@chromium.org, Apr 27 2017

Cc: ihf@chromium.org
Have you considered changing this such that we always tarball directories (not just 500 files). I have suggested this for the lab as well. I just would like to be consistent.
Project Member

Comment 4 by bugdroid1@chromium.org, Apr 27 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/601e8965aa252445cf352173b771ec813582865b

commit 601e8965aa252445cf352173b771ec813582865b
Author: Keith Haddow <haddowk@chromium.org>
Date: Thu Apr 27 05:13:14 2017

[moblab] Turn on result file tar and compression

Partners have limited upload speeds, turn on the gs_offloader
option that tars and zips directories with more than 500 files.

This change affects moblab only.

BUG= chromium:715790 
TEST=manual testing on a moblab

Change-Id: I0417bdb0606f9a7e1bdb57105041c30807ff2469
Reviewed-on: https://chromium-review.googlesource.com/488167
Commit-Ready: Keith Haddow <haddowk@chromium.org>
Tested-by: Keith Haddow <haddowk@chromium.org>
Reviewed-by: Jinsong Mu <jinsong@google.com>
Reviewed-by: Keith Haddow <haddowk@chromium.org>

[modify] https://crrev.com/601e8965aa252445cf352173b771ec813582865b/moblab_config.ini

Taring the whole directory would mean changes to the Partner Console pipeline - not impossible but this was the lowest cost option at this time, and it gets us most of the gain because the CTS test subdirectory gets compressed.

We can probably pull some numbers to see how much bandwidth would be saved - however it is nice to have the autotest debug logs not compressed just for ease of debugging.

However if the lab does tar / zip the whole directory we might consider going that way to.
Status: Fixed (was: Assigned)

Comment 7 by dchan@chromium.org, Aug 1 2017

Labels: VerifyIn-61

Comment 8 by dchan@chromium.org, Jan 22 2018

Status: Archived (was: Fixed)

Sign in to add a comment