PreCQ moblab vm is timing out downloading the base container |
|||
Issue description+ set -e + logger -t moblab-base-container-init Starting. + sleep 1 + logger -t moblab-base-container-init Setting up base container. + sudo python /usr/local/autotest/site_utils/lxc.py -s DEBUG:root:Running 'sudo -n true' DEBUG:root:Running 'sudo lxc-ls -P /mnt/moblab/containers -f -F name,state' DEBUG:root:Running 'sudo curl -s https://storage.googleapis.com/abci-ssp/autotest-containers/moblab_base_06.tar.xz -o /tmp/moblab_base_06.tar.xz_RL_scJ' WARNING:root:run process timeout (180) fired on: sudo curl -s https://storage.googleapis.com/abci-ssp/autotest-containers/moblab_base_06.tar.xz -o /tmp/moblab_base_06.tar.xz_RL_scJ DEBUG:root:Running 'sudo test -e "/usr/local/autotest/containers/moblab_base_06"' Traceback (most recent call last): File "/usr/local/autotest/site_utils/lxc.py", line 68, in <module> main() File "/usr/local/autotest/site_utils/lxc.py", line 62, in main image.setup(name=options.name, force_delete=options.force_delete) File "/usr/local/autotest/site_utils/lxc/base_image.py", line 93, in setup self._download_and_install_base_container() File "/usr/local/autotest/site_utils/lxc/base_image.py", line 158, in _download_and_install_base_container lxc.download_extract(container_url, tar_path, self.container_path) File "/usr/local/autotest/site_utils/lxc/lxc.py", line 75, in download_extract _download_via_curl(url, tmp_file.name) File "/usr/local/autotest/client/common_lib/cros/retry.py", line 218, in func_retry remaining_time) File "/usr/local/autotest/client/common_lib/cros/retry.py", line 123, in timeout default_result = func(*args, **kwargs) File "/usr/local/autotest/site_utils/lxc/lxc.py", line 89, in _download_via_curl stderr_tee=common_utils.TEE_TO_LOGS, timeout=3*60) File "/usr/local/autotest/client/common_lib/utils.py", line 744, in run timeout)[0] File "/usr/local/autotest/client/common_lib/utils.py", line 824, in join_bg_jobs "Command(s) did not complete within %d seconds" % timeout) autotest_lib.client.common_lib.error.CmdTimeoutError: Command <sudo curl -s https://storage.googleapis.com/abci-ssp/autotest-containers/moblab_base_06.tar.xz -o /tmp/moblab_base_06.tar.xz_RL_scJ> failed, rc=-9, Command(s) did not complete within 180 seconds * Command: sudo curl -s https://storage.googleapis.com/abci-ssp/autotest- containers/moblab_base_06.tar.xz -o /tmp/moblab_base_06.tar.xz_RL_scJ Exit status: -9 Duration: 186.38762188
,
Jun 25 2018
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/board-overlays/+/fea5eda9b9b5274cc8da3ace95686f5a940312d8 commit fea5eda9b9b5274cc8da3ace95686f5a940312d8 Author: Keith Haddow <haddowk@chromium.org> Date: Mon Jun 25 05:28:48 2018 [moblab] Extend internet check to check network speed Curl commands are timing out - check internet speed on boot up Trybot:https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8942798366735409072 CQ-DEPEND=CL:1113019 TEST=tryjob BUG= chromium:855941 Change-Id: I0ec8554daf661d1a21852cf0ff7617af726a0ca6 Reviewed-on: https://chromium-review.googlesource.com/1113025 Commit-Ready: Keith Haddow <haddowk@chromium.org> Tested-by: Keith Haddow <haddowk@chromium.org> Reviewed-by: Keith Haddow <haddowk@chromium.org> [modify] https://crrev.com/fea5eda9b9b5274cc8da3ace95686f5a940312d8/project-moblab/chromeos-base/chromeos-bsp-moblab/chromeos-bsp-moblab-9999.ebuild [modify] https://crrev.com/fea5eda9b9b5274cc8da3ace95686f5a940312d8/project-moblab/chromeos-base/chromeos-bsp-moblab/files/init/moblab-internetcheck.conf
,
Jul 16
I have not seen this in some time so closing for now. We have some data collected now on network speed if this happens again.
,
Aug 9
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/portage-stable/+/320d3e8316ca26366349f2229d2c6e0ad8db2367 commit 320d3e8316ca26366349f2229d2c6e0ad8db2367 Author: Keith Haddow <haddowk@chromium.org> Date: Thu Aug 09 15:36:10 2018 speedtest-cli: upgraded package to upstream Upgraded net-analyzer/speedtest-cli to version 2.0.0 on amd64 BUG= chromium:855941 TEST=emerge-fizz-moblab net-analyzer/speedtest-cli Change-Id: I45978d7d1ff4333260664bfcab717c8e2233d26b Reviewed-on: https://chromium-review.googlesource.com/1113019 Commit-Ready: Keith Haddow <haddowk@chromium.org> Tested-by: Keith Haddow <haddowk@chromium.org> Reviewed-by: Jason Clinton <jclinton@chromium.org> (cherry picked from commit 0ca5efec50128b1f291a27dbac5a64fd302248f5) Reviewed-on: https://chromium-review.googlesource.com/1169390 Reviewed-by: Keith Haddow <haddowk@chromium.org> Commit-Queue: Keith Haddow <haddowk@chromium.org> Trybot-Ready: Keith Haddow <haddowk@chromium.org> [add] https://crrev.com/320d3e8316ca26366349f2229d2c6e0ad8db2367/net-analyzer/speedtest-cli/metadata.xml [add] https://crrev.com/320d3e8316ca26366349f2229d2c6e0ad8db2367/net-analyzer/speedtest-cli/speedtest-cli-2.0.0.ebuild [add] https://crrev.com/320d3e8316ca26366349f2229d2c6e0ad8db2367/net-analyzer/speedtest-cli/Manifest [add] https://crrev.com/320d3e8316ca26366349f2229d2c6e0ad8db2367/metadata/md5-cache/net-analyzer/speedtest-cli-2.0.0 |
|||
►
Sign in to add a comment |
|||
Comment 1 by bugdroid1@chromium.org
, Jun 25 2018