depot_tools: Swarming + Recipes + Windows => slow uncontrollable updates |
||||||
Issue descriptionIn Buildbot world depot_tools is part of Buildbot checkout. They are somewhat reliably (or at least observably) updated in "update_scripts" step. In new LUCI world depot_tools are deployed to machines as part of the base image (I believe), and updated whenever they are used (using same process as used on developer's machines). This is uncontrollable "invisible" process. As an example, in issue #647446 Windows bots are still occasionally use old version of depot_tools, two weeks after it has been updated. I think it happens because there are many Swarming bots, and very few jobs (that use depot_tools. So each individual bot uses depot_tools infrequently (and thus update its copy infrequently). It is also hard to tell when all bots will eventually have up-to-date version of depot_tools. This is particularly bad on Windows, because depot_tools is the home of Python and Git there.
,
Oct 5 2016
fresh depot_tools without .git is 11M. Can we CIPD-package and CIPD-deploy it? This is easy. Is this enough (am I missing something)? There is no DEPS file, no runhooks. According to https://chromium.googlesource.com/chromium/tools/depot_tools/+/master/bootstrap/win/ gclient auto-bootstraps itself.
,
May 15 2017
This is getting resolved in much better ways by fixing debt in depot_tools (i.e. deploying git+python explicitly as part of tasks). Going to leave this open for now, but we can check back in 1-2 months and I think this will be a non-issue at that point.
,
May 16 2018
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue. Sorry for the inconvenience if the bug really should have been left as Available. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
May 16 2018
Robbie is this still relevant? Assigning for reply only
,
Jun 21 2018
I think this is wontfix. We're now deleting depot_tools as issue 757980.
,
Oct 18
,
Oct 19
|
||||||
►
Sign in to add a comment |
||||||
Comment 1 by estaab@chromium.org
, Oct 5 2016Status: Available (was: Untriaged)