New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 715520 link

Starred by 2 users

Issue metadata

Status: Archived
Owner: ----
Closed: May 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug

Blocked on:
issue 683436
issue 692184

Blocking:
issue 715350
issue 714976



Sign in to add a comment

Running chromium recipes locally doesn't work

Project Member Reported by machenb...@chromium.org, Apr 26 2017

Issue description

This is crucial to resolving otherwise hard-to-repro issues. E.g. use
https://luci-logdog.appspot.com/v/?s=chromium%2Fbb%2Fchromium.gpu%2FLinux_Release__NVIDIA_%2F101401%2F%2B%2Frecipes%2Fsteps%2Fsetup_build%2F0%2Flogs%2Frun_recipe%2F0

The claim is to paste the text into the build checkout root. It doesn't work, error:
Traceback (most recent call last):
  File "/usr/local/google/home/machenbach/v8/infra/build/scripts/slave/.recipe_deps/recipe_engine/recipes.py", line 750, in <module>
    ret = main()
  File "/usr/local/google/home/machenbach/v8/infra/build/scripts/slave/.recipe_deps/recipe_engine/recipes.py", line 668, in main
    return _real_main(args, op_args)
  File "/usr/local/google/home/machenbach/v8/infra/build/scripts/slave/.recipe_deps/recipe_engine/recipes.py", line 718, in _real_main
    return run(package_deps, args, op_args)
  File "/usr/local/google/home/machenbach/v8/infra/build/scripts/slave/.recipe_deps/recipe_engine/recipes.py", line 208, in run
    properties = get_properties_from_file(args.properties_file)
  File "/usr/local/google/home/machenbach/v8/infra/build/scripts/slave/.recipe_deps/recipe_engine/recipes.py", line 183, in get_properties_from_file
    properties_file = sys.stdin if filename == '-' else open(filename)
IOError: [Errno 2] No such file or directory: '/usr/local/google/home/machenbach/v8/infra/build/-'
Uncaught exception (IOError): [Errno 2] No such file or directory: '/usr/local/google/home/machenbach/v8/infra/build/-'

I find it an important feature and we should make sure that running recipes locally always works.
 
Blocking: 714976
Marking blocked bug to show impact. Trying to resolve the problem:
https://build.chromium.org/p/chromium.gpu/builders/Linux%20Release%20%28NVIDIA%29/builds/101529
Owner: iannucci@chromium.org
Status: Assigned (was: Untriaged)
I can't remember, what's our plan for making recipes work locally again?
Hm... I did this the other day and it was working... must have been a recent regression.
Owner: machenb...@chromium.org
Yeah I just tried this locally and it works... something is going on. Can you provide any other details?
It looks like maybe your shell is expanding `-` to `/usr/local/google/home/machenbach/v8/infra/build/-` ?
Status: Fixed (was: Assigned)
Oh, derp... Just looked at the timestamps. I believe I already fixed this over the weekend.  Please re-open if this is still happening.
Blocking: 715350
However, there are still a bunch of other problems with running the chromium recipes locally (see crbug.com/715350). They tend to make a lot of hard-coded assumptions about crap which don't apply to non-bots (stuff like https://cs.chromium.org/chromium/build/scripts/slave/recipe_modules/goma/api.py?q=goma/api.py+package:%5Echromium$&l=24).
Owner: ----
Status: Available (was: Fixed)
Indeed now V8 recipes work again and Chromium gets an inch further, and then bails out with:
OSError: [Errno 13] Permission denied: '/b'

Is there another tracking bug for making the Chromium recipe work locally? If not, I reopen this one for that purpose.

It'd be sufficient for me to have a simple shell script that bootstraps a workstation to "look like a bot". Something like install-build-deps.sh for recipes.

I assume it's just a bit "new path here", "credential file there" kind of stuff...

Here the log of the current failure:
https://paste.googleplex.com/6433800930197504
Components: -Infra>Platform>Recipes Infra>Client>Chrome
Summary: Running chromium recipes locally doesn't work (was: Running recipes locally doesn't work)
Moving this one to client>chrome right now; the recipe engine itself does work with these suckers locally, but there are hard-coded assumptions in places in the modules that chrome uses that cause this to fail.

This may be fixed incidentally as we continue to push out luci lite and as  issue 649202  becomes resolved.

Closing this ticket should probably involve standing up an integration test on an unprovisioned bot (i.e. no special credentials) and verifying that this flow doesn't break. That, or we should be able to assert that the bot context === local developer context and so if it breaks for devs it breaks for bots (and vice versa).
Blockedon: 692184
Blockedon: 683436
Issue 648695 has been merged into this issue.
Project Member

Comment 14 by sheriffbot@chromium.org, May 16 2018

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Cc: -phajdan.jr@chromium.org
Labels: -Pri-1 Pri-3
Status: Available (was: Untriaged)
With 'led' being really helpful, running locally isn't really required anymore in most cases in the future...
Status: Archived (was: Available)
This isn't something we're realistically going to do any time soon.

Sign in to add a comment