Turn on option to tar and zip up results directories |
||||||
Issue descriptionTesting shows that for CTS and GTS upload bandwidth is reduced by 90% and the console and cts pipeline is not affected by this change.
,
Apr 27 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/72dde64f0a93fb784808bb21ba25ee1fe4a7276b commit 72dde64f0a93fb784808bb21ba25ee1fe4a7276b Author: Keith Haddow <haddowk@chromium.org> Date: Thu Apr 27 00:24:39 2017 [moblab] Turn on result file tar and compression Partners have limited upload speeds, turn on the gs_offloader option that tars and zips directories with more than 500 files. This change affects moblab only. BUG= chromium:715790 TEST=manual testing on a moblab Change-Id: I0417bdb0606f9a7e1bdb57105041c30807ff2469 Reviewed-on: https://chromium-review.googlesource.com/487735 Reviewed-by: Keith Haddow <haddowk@chromium.org> Reviewed-by: Jinsong Mu <jinsong@google.com> Commit-Queue: Keith Haddow <haddowk@chromium.org> Tested-by: Keith Haddow <haddowk@chromium.org> Trybot-Ready: Keith Haddow <haddowk@chromium.org> [modify] https://crrev.com/72dde64f0a93fb784808bb21ba25ee1fe4a7276b/moblab_config.ini
,
Apr 27 2017
Have you considered changing this such that we always tarball directories (not just 500 files). I have suggested this for the lab as well. I just would like to be consistent.
,
Apr 27 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/601e8965aa252445cf352173b771ec813582865b commit 601e8965aa252445cf352173b771ec813582865b Author: Keith Haddow <haddowk@chromium.org> Date: Thu Apr 27 05:13:14 2017 [moblab] Turn on result file tar and compression Partners have limited upload speeds, turn on the gs_offloader option that tars and zips directories with more than 500 files. This change affects moblab only. BUG= chromium:715790 TEST=manual testing on a moblab Change-Id: I0417bdb0606f9a7e1bdb57105041c30807ff2469 Reviewed-on: https://chromium-review.googlesource.com/488167 Commit-Ready: Keith Haddow <haddowk@chromium.org> Tested-by: Keith Haddow <haddowk@chromium.org> Reviewed-by: Jinsong Mu <jinsong@google.com> Reviewed-by: Keith Haddow <haddowk@chromium.org> [modify] https://crrev.com/601e8965aa252445cf352173b771ec813582865b/moblab_config.ini
,
Apr 27 2017
Taring the whole directory would mean changes to the Partner Console pipeline - not impossible but this was the lowest cost option at this time, and it gets us most of the gain because the CTS test subdirectory gets compressed. We can probably pull some numbers to see how much bandwidth would be saved - however it is nice to have the autotest debug logs not compressed just for ease of debugging. However if the lab does tar / zip the whole directory we might consider going that way to.
,
Apr 27 2017
,
Aug 1 2017
,
Jan 22 2018
|
||||||
►
Sign in to add a comment |
||||||
Comment 1 by bugdroid1@chromium.org
, Apr 27 2017