New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 788038 link

Starred by 5 users

Issue metadata

Status: Fixed
Owner: ----
Closed: Nov 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 0
Type: Bug

Blocking:
issue 749709



Sign in to add a comment

All bots are failing update step.

Project Member Reported by mmenke@chromium.org, Nov 23 2017

Issue description

Sample failure:  https://logs.chromium.org/v/?s=chromium%2Fbb%2Fchromium.linux%2FLinux_Builder%2F94725%2F%2B%2Frecipes%2Fsteps%2Fbot_update%2F0%2Fstdout

===Running git clone --no-checkout --local --shared 16:39:40.785539 exec_cmd.c:59           Determined executable path from procfs: /b/cipd_path_tools/bin/git
16:39:40.785595 exec_cmd.c:130          Determined executable path: /b/cipd_path_tools/bin
16:39:40.785739 git.c:344               trace: built-in: git 'config' '--global' 'cache.cachepath'
/b/c/git_cache/chromium.googlesource.com-chromium-src /b/c/b/linux/src===
In directory: /b/c/b/linux
16:39:40.794694 exec_cmd.c:59           Determined executable path from procfs: /b/cipd_path_tools/bin/git
16:39:40.794750 exec_cmd.c:130          Determined executable path: /b/cipd_path_tools/bin
16:39:40.794813 git.c:344               trace: built-in: git 'clone' '--no-checkout' '--local' '--shared' '16:39:40.785539 exec_cmd.c:59           Determined executable path from procfs: /b/cipd_path_tools/bin/git
16:39:40.785595 exec_cmd.c:130          Determined executable path: /b/cipd_path_tools/bin
16:39:40.785739 git.c:344               trace: built-in: git '\''config'\'' '\''--global'\'' '\''cache.cachepath'\''
/b/c/git_cache/chromium.googlesource.com-chromium-src' '/b/c/b/linux/src'
Cloning into '/b/c/b/linux/src'...
warning: --local is ignored
16:39:40.796619 run-command.c:626       trace: run_command: 'ssh' '16' 'git-upload-pack '\''39:40.785539 exec_cmd.c:59           Determined executable path from procfs: /b/cipd_path_tools/bin/git
16:39:40.785595 exec_cmd.c:130          Determined executable path: /b/cipd_path_tools/bin
16:39:40.785739 git.c:344               trace: built-in: git '\''\'\'''\''config'\''\'\'''\'' '\''\'\'''\''--global'\''\'\'''\'' '\''\'\'''\''cache.cachepath'\''\'\'''\''
/b/c/git_cache/chromium.googlesource.com-chromium-src'\'''
ssh: connect to host 16 port 22: Invalid argument
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
===Failed in 0.0 mins===
Something failed: git clone --no-checkout --local --shared 16:39:40.785539 exec_cmd.c:59           Determined executable path from procfs: /b/cipd_path_tools/bin/git
16:39:40.785595 exec_cmd.c:130          Determined executable path: /b/cipd_path_tools/bin
16:39:40.785739 git.c:344               trace: built-in: git 'config' '--global' 'cache.cachepath'
/b/c/git_cache/chromium.googlesource.com-chromium-src /b/c/b/linux/src failed with code 128 in /b/c/b/linux..
waiting 2 seconds and trying again...
Marking for removal /b/c/b/linux/src => /b/build/slave/Linux_Builder/build.dead/bot_update/src_fa28fdbab13042f49bd18fca65eb802b
Error renaming /b/c/b/linux/src to /b/build/slave/Linux_Builder/build.dead/bot_update/src_fa28fdbab13042f49bd18fca65eb802b: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/b/rr/tmp25AgSy/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipes/recipe_modules/bot_update/resources/bot_update.py", line 1265, in <module>
    sys.exit(main())
  File "/b/rr/tmp25AgSy/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipes/recipe_modules/bot_update/resources/bot_update.py", line 1249, in main
    checkout(options, git_slns, specs, revisions, step_text, shallow)
  File "/b/rr/tmp25AgSy/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipes/recipe_modules/bot_update/resources/bot_update.py", line 1155, in checkout
    gclient_output = ensure_checkout(**checkout_parameters)
  File "/b/rr/tmp25AgSy/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipes/recipe_modules/bot_update/resources/bot_update.py", line 854, in ensure_checkout
    cleanup_dir)
  File "/b/rr/tmp25AgSy/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipes/recipe_modules/bot_update/resources/bot_update.py", line 591, in git_checkouts
    cleanup_dir)
  File "/b/rr/tmp25AgSy/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipes/recipe_modules/bot_update/resources/bot_update.py", line 675, in _git_checkout
    remove(sln_dir, cleanup_dir)
  File "/b/rr/tmp25AgSy/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipes/recipe_modules/bot_update/resources/bot_update.py", line 287, in remove
    os.rename(target, dest)
OSError: [Errno 2] No such file or directory
step returned non-zero exit code: 1
 

Comment 1 by mmenke@chromium.org, Nov 23 2017

Labels: Infra-Troopers

Comment 2 by mgiuca@chromium.org, Nov 23 2017

Cc: dpranke@chromium.org mgiuca@chromium.org
It looks like the bots are unable to contact Git servers? (Though I am able to fetch and gclient sync locally.)

There was an issue with Git servers earlier in the week (see chromium-dev thread "PSA: Yes, the Gerrit/Git servers are down"). May not be relevant.

Comment 3 by kbr@chromium.org, Nov 23 2017

Issue 788039 has been merged into this issue.
Status: Started (was: Untriaged)
We believe this is the culprit:
https://chromium-review.googlesource.com/c/chromium/tools/depot_tools/+/786691

tandrii@ created the following CLs:
roll: https://crrev.com/c/786279 
cl https://crrev.com/c/786413
linux_chromium_rel_ng passed the bot_update step. We're re-opening the tree.
https://ci.chromium.org/p/chromium/builders/luci.chromium.try/linux_chromium_rel_ng/20033
Status: Fixed (was: Started)

Comment 7 by kbr@chromium.org, Nov 23 2017

Blocking: 749709
Cc: robertma@chromium.org qyears...@chromium.org
 Issue 788145  has been merged into this issue.

Sign in to add a comment