New issue
Advanced search Search tips

Issue 639190 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Mar 2018
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

Glide network errors cause infra-continuous builders to turn red

Project Member Reported by estaab@chromium.org, Aug 19 2016

Issue description

Describe infrastructure request/issue:
Glide fails during git fetches of deps and the whole build fails for chromium.infra infra-continuous-win-32. We should retry or do more caching. It happens with enough frequency that this is hurting our productivity.

Log:
https://luci-logdog.appspot.com/v/?s=chromium%2Fbb%2Fchromium.infra%2Finfra-continuous-win-32%2F3366%2F%2B%2Frecipes%2Fsteps%2Fgo_third_parties%2F0%2Fstdout

[...]
INFO:bootstrap:Go toolset installed: win32-386 go1.6.3
INFO:bootstrap:Installing Glide...
Cloning into '.'...
Note: checking out 'refs/tags/v0.11.0'.
You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.
If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:
  git checkout -b <new-branch-name>
HEAD is now at c8c8c77... Updating changelog for the 0.11.0 release.
INFO:bootstrap:Installed E:\b\rr\tmpdiefkc\w\golang\go\bin\glide.exe
INFO:bootstrap:Removing E:\b\rr\tmpdiefkc\w\golang\tmpn7y8sj
INFO:bootstrap:Glide is installed
[INFO]	Downloading dependencies. Please wait...
[INFO]	--> Fetching updates for github.com/dustin/go-humanize.
[INFO]	--> Fetching updates for cloud.google.com/go.
[INFO]	--> Fetching updates for github.com/golang/lint.
[INFO]	--> Fetching updates for github.com/gorhill/cronexpr.
[INFO]	--> Fetching updates for github.com/gopherjs/gopherjs.
[INFO]	--> Fetching updates for github.com/jtolds/gls.
[INFO]	--> Fetching updates for github.com/julienschmidt/httprouter.
[INFO]	--> Fetching updates for github.com/kardianos/osext.
[INFO]	--> Fetching updates for github.com/kisielk/errcheck.
[INFO]	--> Fetching updates for github.com/golang/protobuf.
[INFO]	--> Fetching updates for github.com/kisielk/gotool.
[INFO]	--> Fetching updates for github.com/kr/pretty.
[INFO]	--> Fetching updates for github.com/kr/text.
[INFO]	--> Fetching updates for github.com/luci/go-endpoints.
[INFO]	--> Fetching updates for github.com/luci/go-render.
[INFO]	--> Fetching updates for github.com/maruel/panicparse.
[INFO]	--> Fetching updates for github.com/maruel/pre-commit-go.
[INFO]	--> Fetching updates for github.com/maruel/subcommands.
[INFO]	--> Fetching updates for github.com/luci/gkvlite.
[INFO]	--> Fetching updates for github.com/go-sql-driver/mysql.
[INFO]	--> Fetching updates for github.com/maruel/ut.
[INFO]	--> Fetching updates for github.com/mitchellh/go-homedir.
[INFO]	--> Fetching updates for github.com/mgutz/ansi.
[INFO]	--> Fetching updates for github.com/op/go-logging.
[INFO]	--> Fetching updates for github.com/pmezard/go-difflib.
[INFO]	--> Fetching updates for github.com/smartystreets/assertions.
[INFO]	--> Fetching updates for github.com/sergi/go-diff.
[INFO]	--> Fetching updates for github.com/smartystreets/goconvey.
[INFO]	--> Fetching updates for github.com/texttheater/golang-levenshtein.
[INFO]	--> Fetching updates for github.com/xtgo/set.
[INFO]	--> Fetching updates for github.com/yosuke-furukawa/json5.
[INFO]	--> Fetching updates for golang.org/x/mobile.
[INFO]	--> Fetching updates for golang.org/x/net.
[INFO]	--> Fetching updates for golang.org/x/oauth2.
[INFO]	--> Fetching updates for golang.org/x/tools.
[INFO]	--> Fetching updates for google.golang.org/api.
[INFO]	--> Fetching updates for google.golang.org/cloud.
[INFO]	--> Fetching updates for google.golang.org/appengine.
[INFO]	--> Fetching updates for google.golang.org/genproto.
[INFO]	--> Fetching updates for google.golang.org/grpc.
[INFO]	--> Fetching updates for gopkg.in/fsnotify.v1.
[INFO]	--> Fetching updates for gopkg.in/natefinch/npipe.v2.
[INFO]	--> Fetching updates for gopkg.in/yaml.v2.
[WARN]	Unable to checkout github.com/golang/protobuf
[ERROR]	Update failed for github.com/golang/protobuf: Unable to get repository
[INFO]	Setting references.
[ERROR]	Failed to set version on github.com/golang/protobuf to 2c1988e8c18d14b142c0b472624f71647cf39adb: open E:\b\rr\tmpdiefkc\w\infra\go\.vendor\vendor\github.com\golang\protobuf: The system cannot find the file specified.
[INFO]	--> Setting version for github.com/maruel/ut to a9c9f15ccfa6f8b90182a53df32f4745586fbae3.
[INFO]	--> Setting version for github.com/kardianos/osext to 29ae4ffbc9a6fe9fb2bc5029050ce6996ea1d3bc.
[INFO]	--> Setting version for github.com/maruel/panicparse to fad3904e072035be3feaceecd7c26fc3139b1d29.
[INFO]	--> Setting version for github.com/jtolds/gls to 8ddce2a84170772b95dd5d576c48d517b22cac63.
[INFO]	--> Setting version for github.com/kr/text to 7cafcd837844e784b526369c9bce262804aebc60.
[INFO]	--> Setting version for github.com/gorhill/cronexpr to f0984319b44273e83de132089ae42b1810f4933b.
[INFO]	--> Setting version for github.com/luci/gkvlite to 33184d2edd2d39ef71c3ed883e8ff752c4a18213.
[INFO]	--> Setting version for github.com/gopherjs/gopherjs to 72e303cb5f235b23471872477b57e573dc1c71d0.
[INFO]	--> Setting version for github.com/kisielk/errcheck to 50ffcb6f3595daac70aff9e63afe8b8b277b1a1a.
[INFO]	--> Setting version for github.com/luci/go-render to fb5bbe650634bbf7a13ac505ccd52e910cd9001d.
[INFO]	--> Setting version for cloud.google.com/go to 3e0a286dfa25437c4b77d04f6eb1053bc8462f0b.
[INFO]	--> Setting version for github.com/luci/go-endpoints to 004b467f9f9b2840089b1166353ae06e5e0e5844.
[INFO]	--> Setting version for github.com/julienschmidt/httprouter to d8ff598a019f2c7bad0980917a588193cf26666e.
[INFO]	--> Setting version for github.com/go-sql-driver/mysql to 0b58b37b664c21f3010e836f1b931e1d0b0b0685.
[INFO]	--> Setting version for github.com/golang/lint to c7bacac2b21ca01afa1dee0acf64df3ce047c28f.
[INFO]	--> Setting version for github.com/maruel/pre-commit-go to d0b732fe4b5068f76271c66f9a9a533bdb656374.
[INFO]	--> Setting version for github.com/kr/pretty to 737b74a46c4bf788349f72cb256fed10aea4d0ac.
[INFO]	--> Setting version for github.com/dustin/go-humanize to 2fcb5204cdc65b4bec9fd0a87606bb0d0e3c54e8.
[INFO]	--> Setting version for github.com/kisielk/gotool to 94d5dba705240ba73ce5d65d83ce44adc749b440.
[INFO]	--> Setting version for github.com/mitchellh/go-homedir to 756f7b183b7ab78acdbbee5c7f392838ed459dda.
[INFO]	--> Setting version for github.com/op/go-logging to 970db520ece77730c7e4724c61121037378659d9.
[INFO]	--> Setting version for github.com/pmezard/go-difflib to 792786c7400a136282c1664665ae0a8db921c6c2.
[INFO]	--> Setting version for golang.org/x/mobile to 8ab5dbbea1dc4713a98b6f1d51de4582a43e3fa8.
[INFO]	--> Setting version for github.com/xtgo/set to 4431f6b51265b1e0b76af4dafc09d6f12c2bdcd0.
[INFO]	--> Setting version for github.com/maruel/subcommands to a4141cc8723941ce5b7a9ab87b77f397a80e2be6.
[INFO]	--> Setting version for github.com/smartystreets/assertions to 2063fd1cc7c975db70502811a34b06ad034ccdf2.
[INFO]	--> Setting version for github.com/smartystreets/goconvey to 4622128e06c77c0174e17a7f0ed2db19a989b473.
[INFO]	--> Setting version for github.com/yosuke-furukawa/json5 to 07fdad7a3c55f2098b172ea58890470c07f7d392.
[INFO]	--> Setting version for github.com/mgutz/ansi to c286dcecd19ff979eeb73ea444e479b903f2cfcb.
[INFO]	--> Setting version for google.golang.org/api to 8ae9b02432fd8417fb9359af58f473036b094d20.
[INFO]	--> Setting version for golang.org/x/net to 075e191f18186a8ff2becaf64478e30f4545cdad.
[INFO]	--> Setting version for golang.org/x/tools to 855bbc50ad86de9aa46f829ff040ed8edc5b4c37.
[INFO]	--> Setting version for github.com/texttheater/golang-levenshtein to 1298e830a5c134c6830b6d472b7b81faa9492c0a.
[INFO]	--> Setting version for golang.org/x/oauth2 to 4784bb855e56a530f1ce5d788959359ed6cb4a16.
[INFO]	--> Setting version for google.golang.org/cloud to c14fbfa4d259bf20a9a236a19c03a8b05f12b444.
[INFO]	--> Setting version for gopkg.in/fsnotify.v1 to 8611c35ab31c1c28aa903d33cf8b6e44a399b09e.
[INFO]	--> Setting version for github.com/sergi/go-diff to ec7fdbb58eb3e300c8595ad5ac74a5aa50019cc7.
[INFO]	--> Setting version for google.golang.org/genproto to 364c915bc4e89ee7389c63148ecac593ac9368c4.
[INFO]	--> Setting version for google.golang.org/appengine to e951d3868b377b14f4e60efa3a301532ee3c1ebf.
[INFO]	--> Setting version for google.golang.org/grpc to edc5ccf8cbfd321723e26d2cf177b05c16132ad9.
[INFO]	--> Setting version for gopkg.in/natefinch/npipe.v2 to c1b8fa8bdccecb0b8db834ee0b92fdbcfa606dd6.
[INFO]	--> Setting version for gopkg.in/yaml.v2 to e4d366fc3c7938e2958e662b4258c7a89e1f0e3e.
An Error has occurred
------------------------WARNING! WARNING! WARNING!------------------------
E:\b\rr\tmpdiefkc\w\infra\go\.vendor was probably left in an inconsistent state!
You may want to remove it completely and build it again by running
"deps.py install".
--------------------------------------------------------------------------
"glide install" FAILED, see the log
Traceback (most recent call last):
  File "E:\b\rr\tmpdiefkc\w\infra\go\env.py", line 30, in <module>
    new = bootstrap.prepare_go_environ()
  File "E:\b\rr\tmpdiefkc\w\infra\go\bootstrap.py", line 457, in prepare_go_environ
    bootstrap([WORKSPACE], logging.INFO)
  File "E:\b\rr\tmpdiefkc\w\infra\go\bootstrap.py", line 437, in bootstrap
    update_vendor_packages(p, force=updated)
  File "E:\b\rr\tmpdiefkc\w\infra\go\bootstrap.py", line 324, in update_vendor_packages
    subprocess.check_call(cmd, stdout=sys.stderr)
  File "E:\b\depot_tools\python276_bin\lib\subprocess.py", line 540, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['E:\\b\\depot_tools\\python276_bin\\python.exe', '-u', 'E:\\b\\rr\\tmpdiefkc\\w\\infra\\go\\deps.py', '--workspace', 'E:\\b\\rr\\tmpdiefkc\\w\\infra\\go', 'install', '--force']' returned non-zero exit status 1
step returned non-zero exit code: 1
 
Labels: Type-Bug
Labels: Pri-2
If this is really a Pri-1, find an owner and update the priority.

This is the result of a bulk edit that moved high priority available bugs to a lower priority in an attempt to be more honest with bug filers.
Project Member

Comment 3 by sheriffbot@chromium.org, Mar 9 2018

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available. If you change it back, also remove the "Hotlist-Recharge-Cold" label.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Labels: -Hotlist-Recharge-Cold
Owner: vadimsh@chromium.org
Status: Fixed (was: Untriaged)
I think Vadim has fixed this since then.

Sign in to add a comment