New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 650355 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Sep 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Linux
Pri: 2
Type: Bug



Sign in to add a comment

Recipe engine remote run network flakes are fatal

Project Member Reported by martiniss@chromium.org, Sep 26 2016

Issue description

From https://build.chromium.org/p/tryserver.chromium.win/builders/win_chromium_x64_rel_ng/builds/286430/steps/steps/logs/stdio

INFO:root:Running: ['git.bat', 'clone', '-q', 'https://chromium.googlesource.com/chromium/tools/build.git', 'E:\\b\\rr\\tmpgzy65a\\rw\\checkout\\infra\\.recipe_deps\\build']
fatal: early EOF
fatal: The remote end hung up unexpectedly
fatal: index-pack failed
error: RPC failed; curl 18 transfer closed with outstanding read data remaining

We have retries in the recipe engine for this, but it looks like these aren't catching these errors, and the engine is just quitting.

cc-ing people who recently looked at retries in remote run.
 
(This seems to not occur that often, hence the low priority)

Comment 2 by d...@chromium.org, Sep 27 2016

Owner: d...@chromium.org
Status: Started (was: Available)
Project Member

Comment 4 by bugdroid1@chromium.org, Sep 27 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/depot_tools.git/+/a8d76db72b6a76515731bf9e0a4c18a7625179f9

commit a8d76db72b6a76515731bf9e0a4c18a7625179f9
Author: recipe-roller <recipe-roller@chromium.org>
Date: Tue Sep 27 00:22:56 2016

Roll recipe dependencies (trivial).

This is an automated CL created by the recipe roller. This CL rolls recipe
changes from upstream projects (e.g. depot_tools) into downstream projects
(e.g. tools/build).

More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug
(or complain)

recipe_engine:
  https://crrev.com/79cf78db1a3c32c7730f3e9006825a95261abe06 Cleanup fetch, fix missing network flake instances (dnj@chromium.org)

TBR=martiniss@chromium.org,phajdan.jr@chromium.org
BUG= chromium:650355 

Recipe-Tryjob-Bypass-Reason: Autoroller
Bugdroid-Send-Email: False
Review-Url: https://codereview.chromium.org/2376543002

[modify] https://crrev.com/a8d76db72b6a76515731bf9e0a4c18a7625179f9/infra/config/recipes.cfg

Project Member

Comment 5 by bugdroid1@chromium.org, Sep 27 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build.git/+/008e93f8e05ac35c48e9a3744d458fb8a18651c8

commit 008e93f8e05ac35c48e9a3744d458fb8a18651c8
Author: recipe-roller <recipe-roller@chromium.org>
Date: Tue Sep 27 00:37:28 2016

Roll recipe dependencies (trivial).

This is an automated CL created by the recipe roller. This CL rolls recipe
changes from upstream projects (e.g. depot_tools) into downstream projects
(e.g. tools/build).

More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug
(or complain)

depot_tools:
  https://crrev.com/a8d76db72b6a76515731bf9e0a4c18a7625179f9 Roll recipe dependencies (trivial). (recipe-roller@chromium.org)
recipe_engine:
  https://crrev.com/79cf78db1a3c32c7730f3e9006825a95261abe06 Cleanup fetch, fix missing network flake instances (dnj@chromium.org)

TBR=martiniss@chromium.org,phajdan.jr@chromium.org
BUG= chromium:650355 

Recipe-Tryjob-Bypass-Reason: Autoroller
Bugdroid-Send-Email: False
Review-Url: https://codereview.chromium.org/2373703002

[modify] https://crrev.com/008e93f8e05ac35c48e9a3744d458fb8a18651c8/infra/config/recipes.cfg

Project Member

Comment 6 by bugdroid1@chromium.org, Sep 27 2016

Project Member

Comment 7 by bugdroid1@chromium.org, Sep 27 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra.git/+/eee3397d00522fbf8e736e4c1d5e7e4e979993a5

commit eee3397d00522fbf8e736e4c1d5e7e4e979993a5
Author: recipe-roller <recipe-roller@chromium.org>
Date: Tue Sep 27 00:55:52 2016

Roll recipe dependencies (trivial).

This is an automated CL created by the recipe roller. This CL rolls recipe
changes from upstream projects (e.g. depot_tools) into downstream projects
(e.g. tools/build).

More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug
(or complain)

build:
  https://crrev.com/008e93f8e05ac35c48e9a3744d458fb8a18651c8 Roll recipe dependencies (trivial). (recipe-roller@chromium.org)
depot_tools:
  https://crrev.com/a8d76db72b6a76515731bf9e0a4c18a7625179f9 Roll recipe dependencies (trivial). (recipe-roller@chromium.org)
recipe_engine:
  https://crrev.com/79cf78db1a3c32c7730f3e9006825a95261abe06 Cleanup fetch, fix missing network flake instances (dnj@chromium.org)

TBR=martiniss@chromium.org,phajdan.jr@chromium.org
BUG= chromium:650355 

Recipe-Tryjob-Bypass-Reason: Autoroller
Bugdroid-Send-Email: False
Review-Url: https://codereview.chromium.org/2377513003

[modify] https://crrev.com/eee3397d00522fbf8e736e4c1d5e7e4e979993a5/infra/config/recipes.cfg

Project Member

Comment 8 by bugdroid1@chromium.org, Sep 27 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/d558a247e91bcb37a954281d533dd50678bba0ba

commit d558a247e91bcb37a954281d533dd50678bba0ba
Author: recipe-roller <recipe-roller@chromium.org>
Date: Tue Sep 27 01:31:32 2016

Roll recipe dependencies (trivial).

This is an automated CL created by the recipe roller. This CL rolls recipe
changes from upstream projects (e.g. depot_tools) into downstream projects
(e.g. tools/build).

More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug
(or complain)

build:
  https://crrev.com/008e93f8e05ac35c48e9a3744d458fb8a18651c8 Roll recipe dependencies (trivial). (recipe-roller@chromium.org)
depot_tools:
  https://crrev.com/a8d76db72b6a76515731bf9e0a4c18a7625179f9 Roll recipe dependencies (trivial). (recipe-roller@chromium.org)
recipe_engine:
  https://crrev.com/79cf78db1a3c32c7730f3e9006825a95261abe06 Cleanup fetch, fix missing network flake instances (dnj@chromium.org)

TBR=martiniss@chromium.org,phajdan.jr@chromium.org
BUG= chromium:650355 

Recipe-Tryjob-Bypass-Reason: Autoroller
Bugdroid-Send-Email: False
Review-Url: https://codereview.chromium.org/2367423003
Cr-Commit-Position: refs/heads/master@{#421072}

[modify] https://crrev.com/d558a247e91bcb37a954281d533dd50678bba0ba/infra/config/recipes.cfg

Comment 9 by d...@chromium.org, Sep 27 2016

Status: Fixed (was: Started)
This should be fixed now.

Sign in to add a comment