New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 678360 link

Starred by 1 user
Status: Verified
Owner:
ayatane@chromium.org
Closed: Jan 2017
Cc:
xixuan@chromium.org
ayatane@chromium.org
█ ra...@google.com
█ nxia@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 0
Type: Bug



Sign in to add a comment

Problem with CL Changes

Project Member Reported by jashur@chromium.org, Jan 4 2017 
Everything checks out correctly but I'm receiving the following error when running the Hook script:

jashur@jashur:~/lab/chromeos-admin/puppet/modules/lab/files/dhcp-server$ repo upload .
Run hook scripts from https://chrome-internal.googlesource.com/chromeos/manifest-internal.git (yes/always/NO)? yes

Errors in PROJECT *chromeos/chromeos-admin*!
    COMMIT ce17eaad:
        Description:
            >Added temp space for devserver
            >
            >BUG=None
            >TEST=presubmit passes
            >
            >Change-Id: Ibde75cd310eb11ea652a36fe26031f5a6bf52afd
            >
            >
        Errors:
            * Hook script "./bin/run_tests" failed with code 1:
              ./find_virtualenv.sh: line 19: virtualenv_dir: unbound variable
              

Preupload failed due to errors in project(s). HINTS:
- To disable some source style checks, and for other hints, see <checkout_dir>/src/repohooks/README
- To upload only current project, run 'repo upload .'

Comment 1 by jashur@chromium.org, Jan 4 2017

Labels: -Pri-1 Pri-0

Comment 2 by jashur@chromium.org, Jan 4 2017 

Changing this to a P0 since it's blocking majority of our work.

All our team members are having the same issue. We don't have anyone that is able to make CL changes.

Comment 3 by nxia@chromium.org, Jan 4 2017 

looking into it. will update.

Comment 4 Deleted

Comment 5 by nxia@chromium.org, Jan 4 2017 

can you run 'repo sync infra_virtualenv' and then do 'repo uplaod .' again to see if it solves the issue? 

I just successfully uploaded a CL without issues: https://chrome-internal-review.googlesource.com/#/c/314679/

Comment 6 by jashur@chromium.org, Jan 4 2017 

Nope, didn't resolve.

jashur@jashur:~/lab/chromeos-admin/puppet/modules/lab/files/dhcp-server$ repo sync infra_virtualenv
error: project infra_virtualenv not found

Comment 7 by ayatane@chromium.org, Jan 4 2017 

You need to be in the checkout root:

$ cd ~/lab
$ repo sync infra_virtualenv

Comment 8 by jashur@chromium.org, Jan 4 2017 

jashur@jashur:~/lab$ repo sync infra_virtualenv
error: project group must be enabled for project infra_virtualenv

Comment 9 by nxia@chromium.org, Jan 5 2017 

or you can run 'repo sync' in ~/lab to sync the all repos.

Comment 10 by jashur@chromium.org, Jan 5 2017 

I ran repo sync and repo sync infra_virtualenv. I did a repo upload . and received the following output:

jashur@jashur:~/lab/chromeos-admin/puppet/modules/lab/files/dhcp-server$ repo upload .
Run hook scripts from https://chrome-internal.googlesource.com/chromeos/manifest-internal.git (yes/always/NO)? yes

Errors in PROJECT *chromeos/chromeos-admin*!
    COMMIT f5c6c96e:
        Description:
            >Added temp space for devserver
            >
            >BUG=None
            >TEST=presubmit passes
            >
            >Change-Id: Ibde75cd310eb11ea652a36fe26031f5a6bf52afd
            >
            >
        Errors:
            * Hook script "./bin/run_tests" failed with code 1:
              Creating or updating virtualenv in .venv
              ../../infra_virtualenv/create_venv: line 83: virtualenv: command not found
              

Preupload failed due to errors in project(s). HINTS:
- To disable some source style checks, and for other hints, see <checkout_dir>/src/repohooks/README
- To upload only current project, run 'repo upload .'

Comment 11 by nxia@chromium.org, Jan 5 2017 

do people need to install virtualenv?  ayatane@

Comment 12 by ayatane@chromium.org, Jan 5 2017 

Yeah, apt-get install python-virtualenv (although I'm a little surprised it isn't installed by default)

jashur@ are there docs your team uses for reference for setting this up?  We should update it to include this.

Comment 13 by dgarr...@chromium.org, Jan 5 2017 

If that's now a requirement, we need to document it, and send out a PSA asking people to install it.

Comment 14 by jashur@chromium.org, Jan 5 2017 

That was definitely the fix. Not sure what change required that install because I've been making changes successfully for a very long time. So I'm assuming others are having a problem too. The main doc should be updated but I'd recommend a PSA as well to notify everyone of the quick change since there are many self-made docs out there for CL Changes. I'll notify the rest of my team about the change so they can get going.

Fix = sudo apt-get install python-virtualenv

Thanks!

Joe

Comment 15 by nxia@chromium.org, Jan 5 2017

Status: Fixed (was: Untriaged)
Thanks Joe. ayatane@, can you also send a PSA about the virtualenv installation and upload change.

I'll close the bug.
Project Member

Comment 16 by bugdroid1@chromium.org, Jan 5 2017 

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/chromeos/chromeos-admin/+/a8ef155d521968f7508336a7d86ceb7fce0a74bb

commit a8ef155d521968f7508336a7d86ceb7fce0a74bb
Author: Allen Li <ayatane@chromium.org>
Date: Thu Jan 05 00:22:35 2017
Project Member

Comment 17 by bugdroid1@chromium.org, Jan 6 2017 

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/chromeos/manifest-internal/+/8d39e64aee3d76c9e3dfe9aa7e7a8aa91c7a5be0

commit 8d39e64aee3d76c9e3dfe9aa7e7a8aa91c7a5be0
Author: Allen Li <ayatane@chromium.org>
Date: Thu Jan 05 00:13:26 2017
Project Member

Comment 18 by bugdroid1@chromium.org, Jan 6 2017 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/manifest/+/cac1d324ef190511c559322fd42d87d77bf6eede

commit cac1d324ef190511c559322fd42d87d77bf6eede
Author: Allen Li <ayatane@chromium.org>
Date: Thu Jan 05 00:17:59 2017

Add infra_virtualenv to labtools checkout

BUG= chromium:678360 
TEST=None

Change-Id: I838abdcb788ed740cd54cf7cc630d6f431918dff
Reviewed-on: https://chromium-review.googlesource.com/425192
Commit-Ready: Allen Li <ayatane@chromium.org>
Tested-by: Allen Li <ayatane@chromium.org>
Reviewed-by: Aviv Keshet <akeshet@chromium.org>

[modify] https://crrev.com/cac1d324ef190511c559322fd42d87d77bf6eede/full.xml

Comment 19 by jashur@google.com, Jan 11 2017 

Re-opening this. I'm receiving the following error when running repo upload .

jashur@jashur:~/lab/chromeos-admin/puppet/modules/lab/files/dhcp-server$ repo upload .
Run hook scripts from https://chrome-internal.googlesource.com/chromeos/manifest-internal.git (yes/always/NO)? yes

Errors in PROJECT *chromeos/chromeos-admin*!
    COMMIT 01c55e03:
        Description:
            >Addeding temp space for chromeos1 devserver build
            >
            >BUG=None
            >TEST=presubmit passes
            >
            >Change-Id: I8c0d41b176aec00db4819611824222bf80084ab0
            >
            >
        Errors:
            * Hook script "./bin/run_tests" failed with code 1:
              Creating or updating virtualenv in /usr/local/google/home/jashur/lab/chromeos-admin/bin/.venv
              New python executable in /usr/local/google/home/jashur/lab/chromeos-admin/bin/.venv/bin/python
              Installing setuptools, pip...done.
              Ignoring indexes: https://pypi.python.org/simple
              Requirement already satisfied (use --upgrade to upgrade): setuptools==28.2.0 in ./.venv/lib/python2.7/site-packages
              Ignoring indexes: https://pypi.python.org/simple
              Requirement already satisfied (use --upgrade to upgrade): pip==8.1.2 in ./.venv/lib/python2.7/site-packages
              Ignoring indexes: https://pypi.python.org/simple
              Obtaining file:///usr/local/google/home/jashur/lab/chromeos-admin/cros-admin (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 1))
              Obtaining file:///usr/local/google/home/jashur/lab/chromeos-admin/vagrant-test (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 2))
              Obtaining file:///usr/local/google/home/jashur/lab/chromeos-admin/server-management-lib (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 3))
              Collecting contextlib2==0.5.4 (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 4))
                Could not find a version that satisfies the requirement contextlib2==0.5.4 (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 4)) (from versions: )
              No matching distribution found for contextlib2==0.5.4 (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 4))
              

Preupload failed due to errors in project(s). HINTS:
- To disable some source style checks, and for other hints, see <checkout_dir>/src/repohooks/README
- To upload only current project, run 'repo upload .'

Comment 20 by jashur@chromium.org, Jan 11 2017

Cc: -dgarr...@chromium.org nxia@chromium.org xixuan@chromium.org
Owner: dgarr...@chromium.org
Status: Untriaged (was: Fixed)
Raising to a P0

Devserver is down and must be replaced. We'll need this resolved immediately to continue the build.

Comment 21 by jashur@chromium.org, Jan 11 2017

Components: Infra

Comment 22 by dgarr...@chromium.org, Jan 11 2017 

This is a different issue, though related. Usually, it's best to file a new issue to avoid confusion.

However, what machine are you seeing the issue on?

Comment 23 by ayatane@chromium.org, Jan 11 2017 

#19, have you tried running repo sync?

cd /usr/local/google/home/jashur/lab && repo sync

Comment 24 by dgarr...@chromium.org, Jan 11 2017

Owner: ayatane@chromium.org

Comment 25 by dgarr...@chromium.org, Jan 11 2017 

In general, it's becoming more important to always do a full repo sync, not just a single repository.

Comment 26 by jashur@chromium.org, Jan 11 2017 

I've been syncing a single repository for about 6 months now with no problem. Reason being is because I keep receiving an error when I do a full repo sync (permissions issue if I can recall correctly). I was told to just sync the repo that we work on and everything was running fine for a while.

Here is the error output for the full repo sync (this is actually the output from the middle of the sync when an error occured):

Fetching project chromeos/overlays/overlay-chell-private
remote: Finding sources: 100% (13/13)           
remote: Total 13 (delta 7), reused 12 (delta 7)        
Fetching project chromeos/overlays/overlay-variant-lemmings-external-private
Fetching project chromeos/vendor/fingerprints-hal
Fetching projects:  96% (393/409)  Fetching project chromeos/lakitu/spiny
Fetching project chromiumos/third_party/seabios
From https://chrome-internal.googlesource.com/chromeos/overlays/overlay-lakitu-private
   6db91b6..330c26d  factory-glados-7828.B -> cros-internal/factory-glados-7828.B
   f62aa19..8e9c57e  factory-oak-8182.B -> cros-internal/factory-oak-8182.B
   db0eb26..6b6b70d  master             -> cros-internal/master
Fetching projects:  97% (397/409)  remote: Finding sources:  10% (1/10)         remote: Finding sources: 100% (10/10)           
remote: Total 10 (delta 2), reused 10 (delta 2)        
Fetching projects:  98% (401/409)  From https://chromium.googlesource.com/chromiumos/platform/mosys
   7d11984..0dca657  factory-gru-9017.B -> cros/factory-gru-9017.B
error: Cannot fetch chrome/tools/build
error: Cannot fetch chrome/tools/release

Here is the error output for the full repo sync (this is the output from the end of the sync):

From https://chromium.googlesource.com/chromiumos/third_party/kernel
   ae574c481a8f..0b178201ea79  chromeos-3.10 -> cros/chromeos-3.10
   8ba92a16392e..a61fa714c082  chromeos-3.14 -> cros/chromeos-3.14
   da55f8c697f6..540775efb011  chromeos-3.18 -> cros/chromeos-3.18
   df76b15e2b00..8440dd224690  chromeos-4.4  -> cros/chromeos-4.4
   002b39926fa5..f89d86908caf  factory-glados-7828.B-chromeos-3.18 -> cros/factory-glados-7828.B-chromeos-3.18
   3cad334f875a..a8f19d8051e1  factory-strago-7458.B-chromeos-3.18 -> cros/factory-strago-7458.B-chromeos-3.18
   c7886986c591..e4d6fbf8512f  release-R56-9000.B-chromeos-3.18 -> cros/release-R56-9000.B-chromeos-3.18
   268c0289a972..030aff712116  release-R56-9000.B-chromeos-4.4 -> cros/release-R56-9000.B-chromeos-4.4
   8d0fed74fba8..9adb3cf2c2de  stabilize-8743.60.B-chromeos-3.18 -> cros/stabilize-8743.60.B-chromeos-3.18
Fetching project chromiumos/third_party/kernel
From https://chromium.googlesource.com/chromiumos/third_party/kernel
   ae574c481a8f..0b178201ea79  chromeos-3.10 -> cros/chromeos-3.10
   8ba92a16392e..a61fa714c082  chromeos-3.14 -> cros/chromeos-3.14
   da55f8c697f6..540775efb011  chromeos-3.18 -> cros/chromeos-3.18
   df76b15e2b00..8440dd224690  chromeos-4.4  -> cros/chromeos-4.4
   002b39926fa5..f89d86908caf  factory-glados-7828.B-chromeos-3.18 -> cros/factory-glados-7828.B-chromeos-3.18
   3cad334f875a..a8f19d8051e1  factory-strago-7458.B-chromeos-3.18 -> cros/factory-strago-7458.B-chromeos-3.18
   c7886986c591..e4d6fbf8512f  release-R56-9000.B-chromeos-3.18 -> cros/release-R56-9000.B-chromeos-3.18
   268c0289a972..030aff712116  release-R56-9000.B-chromeos-4.4 -> cros/release-R56-9000.B-chromeos-4.4
   8d0fed74fba8..9adb3cf2c2de  stabilize-8743.60.B-chromeos-3.18 -> cros/stabilize-8743.60.B-chromeos-3.18

error: Exited sync due to fetch errors

Comment 27 by ayatane@chromium.org, Jan 11 2017 

In the interest of solving your immediate problem, I think passing -f to repo sync will ignore the failing repos and sync everything else

cd /usr/local/google/home/jashur/lab && repo sync -f

For the longer term, it sounds like there is a process or documentation issue.  Can you reproduce the error from a fresh checkout (i.e., create a new checkout in /usr/local/google/home/jashur/lab-tmp)?

Comment 28 by jashur@chromium.org, Jan 12 2017

Cc: ra...@google.com
I tried doing that and I'm still receiving errors. It looks like a permissions issues, giving me access denied. That's the same reason why I was told to only sync the single repo. It worked the passed 6 months.

So here's a quick summary:
When my environment was first built, I was able to do a full repo sync for about 1-2 weeks before it started failing and giving me access denied and fetch errors.

Then I was told to just sync the single repository and it's been working perfect ever since.

My environment broke about a month ago and it was completely rebuilt by @krisr. Again I was able to do a full repo sync for about 1-2 weeks before doing the same thing, giving me access denied and fetch errors.

So from there, I just continued to sync the single repository and it was working fine until I received the first issue you see in Comment #1. Then it was fixed for a short while until I received the second issue seen in Comment #19.

I am still able to do a successful single repo sync using "repo sync ." but when I do a full repo sync using "repo sync -f" to ignore the failing repos, I receive the access denied and fetch errors problem seen in the full output below:

jashur@jashur:~/lab$ repo sync -f
Fetching project chromiumos/platform/crosutils
Fetching project chromeos/overlays/overlay-eve-private
Fetching project chromeos/platform/actions
Fetching project chromiumos/platform/memento_softwareupdate
Fetching project chromiumos/third_party/hdctools
Fetching project chromeos/overlays/overlay-kefka-private
Fetching project chromeos/vendor/madison-cromo-plugin
Fetching project chromiumos/platform/inputcontrol
Fetching project chromiumos/third_party/gobi3k-sdk
Fetching project chromeos/overlays/overlay-variant-stumpy-moblab-private
Fetching project chromiumos/third_party/cbootimage
Fetching project chromeos/third_party/intel-framework
Fetching project chromeos/overlays/overlay-daisy-private
Fetching projects:   1% (6/409)  Fetching project chromeos/overlays/overlay-wolf-private
Fetching project chromeos/overlays/overlay-monroe-private
Fetching project chromeos/overlays/overlay-variant-veyron-mickey-private
Fetching projects:   2% (9/409)  Fetching project chromiumos/platform/ec
Fetching project chromeos/overlays/overlay-aplrvp-private
Fetching project apps/libapps
Fetching project chromeos/overlays/overlay-leon-private
Fetching projects:   3% (13/409)  Fetching project chromiumos/third_party/memtest
Fetching project chromeos/overlays/baseboard-oak-private
Fetching project chromeos/overlays/overlay-rowan-private
Fetching project chromeos/overlays/chipset-rk3399-private
Fetching projects:   4% (17/409)  Fetching project chromiumos/platform/chromiumos-assets
Fetching project chromeos/overlays/overlay-variant-nyan-big-private
Fetching project chromeos/platform/wifi-testbed
Fetching project chromeos/overlays/overlay-gnawty-private
Fetching projects:   5% (21/409)  Fetching project platform/system/core
Fetching project chromeos/overlays/overlay-cyan-private
Fetching project chromiumos/platform/dev-util
Fetching project chromeos/overlays/overlay-variant-daisy-spring-private
Fetching projects:   6% (25/409)  Fetching project chromiumos/third_party/atheros
Fetching project chromeos/overlays/baseboard-reef-private
Fetching project chromeos/overlays/chipset-dakota-private
Fetching project chromiumos/third_party/tlsdate
Fetching projects:   7% (29/409)  Fetching project chromiumos/platform/audiotest
Fetching project chromeos/overlays/overlay-variant-peach-pit-private
Fetching project chromeos/overlays/overlay-smaug-private
Fetching project chromiumos/platform/bmpblk
Fetching projects:   8% (33/409)  Fetching project chromeos/thermald
Fetching project chromiumos/platform/mtpd
Fetching project chromeos/overlays/overlay-variant-auron-yuna-private
Fetching project chromiumos/platform/arc-camera
Fetching projects:   9% (37/409)  Fetching project chromeos/docs
Fetching project chromeos/overlays/overlay-plaso-private
Fetching project chromeos/platform/gcp
Fetching project chromeos/autotest-private
Fetching projects:  10% (41/409)  Fetching project chromiumos/third_party/ibus-chewing
Fetching project chromiumos/platform/firmware
Fetching project chromeos/platform/echo
Fetching project chromiumos/platform/experimental
Fetching projects:  11% (45/409)  Fetching project chromeos/vendor/gobi-firmware
Fetching project chromeos/overlays/overlay-beaglebone-private
Fetching project chromeos/overlays/overlay-relm-private
Fetching project chromiumos/third_party/libc-bench
Fetching project chromeos/overlays/overlay-lakitu-gpu-private
Fetching projects:  12% (50/409)  Fetching project chromeos/overlays/chromeos-overlay
Fetching project chromeos/overlays/chromeos-partner-overlay
Fetching project chromeos/overlays/overlay-variant-storm-nand-private
Fetching project chromiumos/platform/factory
Fetching projects:  13% (54/409)  Fetching project chromiumos/third_party/libmbim
Fetching project chromeos/vendor/nvidia-kernel
Fetching project chromiumos/platform/xorg-conf
Fetching project chromeos/relaypoint
Fetching projects:  14% (58/409)  Fetching project chromiumos/platform/dm-verity
Fetching project chromiumos/third_party/grub2
Fetching project chromeos/overlays/overlay-stumpy-private
Fetching project chromiumos/platform/mtplot
Fetching projects:  15% (62/409)  Fetching project chromeos/overlays/overlay-storm-private
Fetching project chromeos/overlays/overlay-smaug-cheets-private
Fetching project chromeos/overlays/overlay-lars-private
Fetching project chromeos/overlays/overlay-variant-veyron-fievel-private
Fetching projects:  16% (66/409)  Fetching project chromeos/overlays/overlay-scarlet-private
Fetching project chromeos/overlays/overlay-tricky-private
Fetching project chromeos/ap
Fetching project chromeos/manifest-internal
Fetching projects:  17% (70/409)  Fetching project chromiumos/platform/touchpad-tests
Fetching project chromeos/overlays/overlay-glimmer-cheets-private
Fetching project chromeos/chromeos-admin
Fetching project chromiumos/platform/depthcharge
Fetching projects:  18% (74/409)  Fetching project chromiumos/overlays/portage-stable
Fetching project chromeos/overlays/overlay-variant-daisy-skate-private
Fetching project chromeos/vendor/rockchip-kernel
Fetching project aosp/platform/system/connectivity/shill
Fetching projects:  19% (78/409)  Fetching project chromeos/overlays/overlay-pyro-private
Fetching project chromeos/overlays/overlay-ultima-private
Fetching project chromiumos/platform/vpd
Fetching project chromeos/platform/factory-private
Fetching projects:  20% (82/409)  Fetching project chromeos/overlays/overlay-sentry-private
Fetching project chromeos/overlays/overlay-arkham-private
Fetching project chromeos/overlays/baseboard-gru-private
Fetching project chromeos/vendor/nvidia-cbootimage
Fetching projects:  21% (86/409)  Fetching project chromiumos/platform/tpm_lite
Fetching project chromium/src/third_party/hwcplus
Fetching project chromeos/overlays/overlay-rikku-private
Fetching project chromeos/overlays/overlay-elm-private
Fetching projects:  22% (90/409)  Fetching project external/swarming.client
Fetching project chromeos/overlays/overlay-lumpy-private
Fetching project chromiumos/third_party/libsigrok-cli
Fetching project chromeos/overlays/overlay-variant-auron-pearlvalley-private
Fetching project chromeos/overlays/overlay-variant-lakitu-next-private
Fetching projects:  23% (95/409)  Fetching project chromiumos/third_party/linux-firmware
Fetching project aosp/platform/system/tpm
Fetching project chromeos/overlays/overlay-kunimitsu-private
Fetching project chromiumos/platform2
Fetching projects:  24% (99/409)  Fetching project external/git.kernel.org/fs/xfs/xfstests-dev
Fetching project chromeos/overlays/chipset-bdw-private
Fetching project chromeos/overlays/overlay-cyan-cheets-private
Fetching project chromeos/overlays/overlay-amenia-private
Fetching projects:  25% (103/409)  Fetching project chromeos/overlays/chipset-apl-private
Fetching project chromeos/overlays/overlay-x86-alex-private
Fetching project chromeos/crostools
Fetching project chromiumos/graphyte
Fetching projects:  26% (107/409)  Fetching project chromiumos/platform/touchbot
Fetching project chromiumos/third_party/sysbios
Fetching project chromiumos/third_party/u-boot
Fetching project chromeos/overlays/overlay-hana-private
Fetching projects:  27% (111/409)  Fetching project chromeos/overlays/overlay-reks-private
Fetching project chromeos/overlays/overlay-variant-x86-zgb-he-private
Fetching project chromeos/overlays/overlay-terra-private
Fetching project chromeos/overlays/baseboard-glados-private
Fetching projects:  28% (115/409)  Fetching project chromeos/vendor/mali-ddk
Fetching project chromiumos/platform/xf86-input-cmt
Fetching project chromeos/requirements
Fetching project chromeos/platform/ec-private-cr52
Fetching projects:  29% (119/409)  Fetching project chromiumos/third_party/arm-trusted-firmware
Fetching project chromeos/overlays/overlay-poppy-private
Fetching project aosp/platform/system/firewalld
Fetching project chromeos/overlays/overlay-whirlwind-private
Fetching projects:  30% (123/409)  Fetching project chromeos/vendor/kernel-intel-staging
Fetching project chromeos/overlays/overlay-amd64-generic-cheets-private
Fetching project chromeos/overlays/overlay-variant-parrot-ivb-private
Fetching project chromeos/overlays/overlay-variant-veyron-gus-private
Fetching projects:  31% (127/409)  Fetching project chromiumos/third_party/u-boot
Fetching project chromeos/overlays/overlay-cyclone-private
Fetching project chromeos/overlays/overlay-veyron-private
Fetching project chromeos/vendor/img-ddk
Fetching project chromeos/overlays/overlay-rambi-private
Fetching projects:  32% (131/409)  Fetching project chromeos/overlays/overlay-zako-private
Fetching project chromeos/overlays/overlay-peach-private
Fetching project chromeos/overlays/overlay-variant-veyron-tiger-private
Fetching project linux-syscall-support
Fetching projects:  33% (135/409)  Fetching project chromeos/overlays/overlay-kip-private
Fetching project chromeos/overlays/chipset-kbl-private
Fetching project chromiumos/third_party/tegra-power-query
Fetching project chromiumos/platform/btsocket
Fetching project chromeos/overlays/overlay-wizpig-private
Fetching projects:  34% (140/409)  Fetching project chromiumos/platform/tpm
Fetching project chromeos/overlays/overlay-bolt-private
Fetching project chromeos/overlays/overlay-swanky-private
Fetching project chromeos/overlays/overlay-glados-private
Fetching projects:  35% (144/409)  Fetching project chromeos/overlays/overlay-reef-private
Fetching project chromeos/overlays/overlay-amd64-generic-goofy-private
Fetching project chromeos/overlays/overlay-mccloud-private
Fetching project chromiumos/third_party/dbus-spy
Fetching projects:  36% (148/409)  Fetching project chromeos/overlays/overlay-caroline-private
Fetching project aosp/platform/external/libchrome
Fetching project chromiumos/third_party/libsigrokdecode
Fetching project chromeos/vendor/dlm
Fetching projects:  37% (152/409)  Fetching project chromeos/overlays/overlay-nyan-private
Fetching project chromiumos/chromite
Fetching project aosp/platform/system/update_engine
Fetching project chromeos/overlays/project-cheets-private
Fetching projects:  38% (156/409)  Fetching project chromiumos/third_party/adhd
Fetching project chromiumos/third_party/ply-image
Fetching project chromeos/autotest-cheets
Fetching project chromiumos/third_party/trousers
Fetching projects:  39% (160/409)  Fetching project chromiumos/third_party/dpkt
Fetching project chromiumos/platform/gestures
Fetching project chromiumos/third_party/tegrastats
Fetching project chromiumos/third_party/mmc-utils
Fetching projects:  40% (164/409)  Fetching project chromeos/overlays/project-mobbase-private
Fetching project chromiumos/infra_virtualenv
Fetching project chromiumos/third_party/tpm2
Fetching project chromeos/vendor/marvell-kernel
Fetching projects:  41% (168/409)  Fetching project chromeos/third_party/nvidia-firmware-private
Fetching project chromeos/overlays/overlay-candy-private
Fetching project chromeos/overlays/overlay-cranky-private
Fetching project chromeos/overlays/baseboard-poppy-private
Fetching projects:  42% (172/409)  Fetching project chromeos/overlays/overlay-marble-private
Fetching project chromiumos/third_party/flashrom
Fetching project chromeos/vendor/nvidia-bpmp
Fetching project chromeos/overlays/overlay-variant-nyan-blaze-private
Fetching projects:  43% (176/409)  Fetching project chromeos/overlays/overlay-variant-veyron-pinky-private
Fetching project chromeos/overlays/overlay-x86-mario-private
Fetching project chromeos/chromeos-assets
Fetching project chromeos/overlays/overlay-smaug-kasan-private
Fetching projects:  44% (180/409)  Fetching project chromeos/overlays/overlay-tidus-private
Fetching project chromeos/overlays/overlay-gale-private
Fetching project chromeos/overlays/overlay-strago-private
Fetching project aosp/platform/system/connectivity/apmanager
Fetching project chromeos/overlays/chipset-skl-private
Fetching projects:  45% (185/409)  Fetching project aosp/platform/external/modp_b64
Fetching project chromeos/overlays/overlay-samus-cheets-private
Fetching project chromeos/overlays/overlay-variant-veyron-minnie-private
Fetching project chromeos/overlays/overlay-variant-panther-moblab-private
Fetching projects:  46% (189/409)  Fetching project chromeos/overlays/overlay-electro-private
Fetching project chromiumos/third_party/edk2
Fetching project chromiumos/overlays/chromiumos-overlay
Fetching project chromeos/autotest-private-utils
Fetching projects:  47% (193/409)  Fetching project chromeos/overlays/overlay-sklrvp-private
Fetching project chromeos/overlays/overlay-bob-private
Fetching project chromeos/overlays/overlay-variant-veyron-jaq-private
Fetching project chromeos/overlays/baseboard-jecht-private
Fetching projects:  48% (197/409)  Fetching project chromiumos/platform/battery_updater
Fetching project chromiumos/third_party/flashmap
Fetching project chromiumos/platform/webplot
Fetching project chromeos/third_party/qca-framework
Fetching projects:  49% (201/409)  Fetching project chromeos/overlays/overlay-lulu-cheets-private
Fetching project chromiumos/third_party/minifakedns
Fetching project chromeos/toolchain-utils
Fetching project chromiumos/platform/google-breakpad
Fetching projects:  50% (205/409)  Fetching project chromeos/vendor/gdmwimax
Fetching project toolchain/binutils
Fetching project chrome/tools/build
Fetching project chromiumos/third_party/autotest
Fetching projects:  51% (209/409)  Fetching project toolchain/gcc
Fetching project chromiumos/third_party/coreboot/blobs
Fetching project chromeos/overlays/overlay-cave-private
Fetching project chromeos/overlays/overlay-buddy-private
Fetching projects:  52% (213/409)  Fetching project chromeos/third_party/nvidia-atf
Fetching project chromeos/overlays/overlay-variant-veyron-speedy-private
Fetching project chromeos/overlays/overlay-kevin-private
Fetching project chromeos/overlays/overlay-glados-cheets-private
Fetching projects:  53% (217/409)  Fetching project chromiumos/third_party/android_mtdutils
Fetching project chromiumos/third_party/ibus-xkb-layouts
Fetching project chromiumos/third_party/coreboot
fatal: remote error: Access denied to jashur@google.com
Fetching project chromeos/vendor/altair-firmware
Fetching projects:  54% (221/409)  Fetching project chromeos/overlays/overlay-banon-private
Fetching project chromeos/cros-signing
Fetching project chrome/tools/release
Fetching project chromeos/overlays/overlay-link-private
Fetching projects:  55% (225/409)  Fetching project chromeos/overlays/chipset-bsw-private
Fetching project chromeos/overlays/overlay-oak-private
fatal: remote error: Access denied to jashur@google.com
Fetching project chromeos/overlays/overlay-gandof-private
Fetching project chromeos/vendor/icera-firmware-tools
Fetching project chromeos/plaso
Fetching projects:  56% (230/409)  Fetching project chromiumos/third_party/rootdev
Fetching project chromiumos/third_party/libsigrok
Fetching project weave/libweave
Fetching project chromeos/overlays/overlay-setzer-private
Fetching projects:  57% (234/409)  Fetching project chromeos/overlays/overlay-anglar-private
Fetching project chromeos/overlays/overlay-clapper-private
Fetching project chromiumos/platform/jabra_vold
Fetching project chromeos/overlays/overlay-shogun-private
Fetching projects:  58% (238/409)  Fetching project chromiumos/platform/drm-tests
Fetching project chromeos/overlays/overlay-umaro-private
Fetching project chromeos/overlays/overlay-squawks-private
Fetching project chromeos/overlays/overlay-variant-lakitu-mobbuild-private
Fetching projects:  59% (242/409)  Fetching project chromeos/overlays/overlay-heli-private
Fetching project chromiumos/third_party/broadcom
Fetching project chromium/deps/libmtp
Fetching project chromeos/overlays/overlay-lulu-private
Fetching projects:  60% (246/409)  Fetching project chromeos/platform/experimental-touch-fw
Fetching project chromeos/overlays/overlay-gru-private
Fetching project chromeos/platform/vox
Fetching project chromiumos/platform/go-seccomp
Fetching projects:  61% (250/409)  Fetching project chromeos/overlays/baseboard-gale-private
Fetching project aosp/platform/external/dbus-binding-generator
Fetching project chromiumos/platform/libevdev
Fetching project platform/external/minijail
Fetching projects:  62% (254/409)  Fetching project chromiumos/platform/punybench
Fetching project chromiumos/platform/assets
Fetching project chromiumos/third_party/gdata
Fetching project chromiumos/platform/imageloader
Fetching projects:  63% (258/409)  Fetching project chromeos/overlays/overlay-samus-private
Fetching project chromeos/overlays/overlay-purin-private
Fetching project chromeos/overlays/overlay-variant-auron-paine-private
Fetching project chromeos/overlays/overlay-stout-private
Fetching projects:  64% (262/409)  Fetching project chromeos/overlays/overlay-snappy-private
Fetching project chromeos/overlays/overlay-enguarde-private
Fetching project chromiumos/third_party/mesa
Fetching project chromiumos/platform/touch_noise_filter
Fetching projects:  65% (266/409)  Fetching project chromeos/overlays/overlay-elm-cheets-private
Fetching project chromiumos/third_party/xf86-video-armsoc
Fetching project chromiumos/third_party/bootstub
Fetching project chromeos/overlays/overlay-celes-private
Fetching projects:  66% (270/409)  Fetching project chromeos/overlays/overlay-variant-peach-kirby-private
Fetching project chromeos/overlays/chipset-mt8173-private
Fetching project chromiumos/third_party/mesa
Fetching project chromeos/overlays/overlay-slippy-private
Fetching project chromeos/overlays/overlay-chell-cheets-private
Fetching project chromeos/overlays/project-jetstream-private
Fetching projects:  67% (275/409)  Fetching project chromiumos/platform/uboot-env
Fetching project chromiumos/third_party/khronos
Fetching project chromeos/overlays/overlay-variant-nyan-kitty-private
Fetching project chromeos/overlays/overlay-variant-veyron-rialto-private
Fetching projects:  68% (279/409)  Fetching project chromeos/platform/keyboard_layout
Fetching project chromiumos/third_party/mesa
Fetching project chromiumos/platform/bootcache
Fetching project chromeos/ap/security
Fetching project chromeos/platform/ec-private-cr53
Fetching projects:  69% (283/409)  Fetching project chromeos/overlays/overlay-orco-private
Fetching project chromiumos/manifest
Fetching project chromiumos/third_party/libv4lplugins
Fetching project chromeos/cheets-scripts
Fetching projects:  70% (287/409)  Fetching project platform/bootable/recovery
Fetching project chromeos/overlays/overlay-variant-veyron-mighty-private
Fetching project chromeos/overlays/project-goofy-private
Fetching project chromeos/overlays/overlay-kblrvp-private
Fetching projects:  71% (291/409)  Fetching project chromiumos/third_party/pyelftools
Fetching project chromiumos/repohooks
Fetching project chromiumos/third_party/chrontel
Fetching project chromeos/platform/google_enterprise_policy
Fetching projects:  72% (295/409)  Fetching project chromiumos/platform/factory_installer
Fetching project chromeos/overlays/overlay-variant-x86-alex-he-private
Fetching project chromeos/third_party/wpan-tools
Fetching project chromeos/overlays/overlay-parrot-private
Fetching projects:  73% (299/409)  Fetching project chromeos/platform/ec-private
Fetching project chromiumos/platform/crostestutils
Fetching project chromeos/ap-daemons
Fetching project chromiumos/third_party/libresample
Fetching projects:  74% (303/409)  Fetching project chromiumos/platform/frecon
Fetching project chromiumos/platform/system_api
Fetching project chromiumos/third_party/gdmwimax
Fetching project chromiumos/third_party/opencryptoki
Fetching projects:  75% (307/409)  Fetching project chromiumos/platform/minigbm
Fetching project chromeos/overlays/overlay-rotor-private
Fetching project platform/external/bsdiff
Fetching project chromeos/vendor/silabs
Fetching projects:  76% (311/409)  Fetching project chromeos/overlays/overlay-panther-private
Fetching project chromiumos/overlays/board-overlays
Fetching project chromeos/overlays/overlay-peppy-private
Fetching project chromiumos/third_party/gcc
Fetching projects:  77% (315/409)  Fetching project chromeos/overlays/overlay-banjo-private
Fetching project chromeos/overlays/overlay-ninja-private
Fetching project chromiumos/platform/chameleon
Fetching project chromiumos/third_party/dbus-cplusplus
Fetching project chromeos/overlays/overlay-variant-guado-labstation-private
Fetching projects:  78% (320/409)  Fetching project chromeos/overlays/overlay-x86-zgb-private
Fetching project chromiumos/third_party/cypress-tools
Fetching project chromeos/overlays/overlay-parry-private
Fetching project chromeos/overlays/overlay-miles-private
Fetching projects:  79% (324/409)  Fetching project chromeos/overlays/overlay-walnut-private
Fetching project chromeos/overlays/chromeos-overlay-oak
Fetching project chromeos/platform/ec-private-cr51
Fetching project chromiumos/platform/vboot_reference
Fetching projects:  80% (328/409)  Fetching project chromeos/overlays/baseboard-auron-private
Fetching project chromiumos/third_party/em100
Fetching project chromiumos/third_party/tpm-emulator
Fetching project chromiumos/third_party/libscrypt
Fetching projects:  81% (332/409)  Fetching project chromiumos/overlays/eclass-overlay
Fetching project chromeos/autotest-lakitu
Fetching project chromiumos/third_party/modemmanager-next
Fetching project chromeos/overlays/overlay-falco-private
Fetching projects:  82% (336/409)  Fetching project chromeos/overlays/overlay-guado-private
Fetching project chromeos/overlays/overlay-winky-private
Fetching project chromiumos/third_party/libdrm
Fetching project chromeos/platform/whisper
Fetching projects:  83% (340/409)  Fetching project chromeos/overlays/overlay-cid-private
Fetching project chromeos/overlays/baseboard-strago-private
Fetching project chromiumos/platform/mttools
Fetching project chromeos/overlays/overlay-edgar-private
Fetching projects:  84% (344/409)  Fetching project chromeos/overlays/overlay-jecht-private
Fetching project chromiumos/platform/workarounds
Fetching project chromiumos/third_party/kernel
Fetching project chromeos/overlays/overlay-quawks-private
Fetching projects:  85% (348/409)  Fetching project aosp/platform/external/libbrillo
Fetching project chromeos/platform/easy-unlock-crypto
Fetching project chromeos/overlays/baseboard-kunimitsu-private
Fetching project chromiumos/third_party/hwcplus-drm
Fetching projects:  86% (352/409)  Fetching project chromeos/overlays/overlay-variant-veyron-speedy-cheets-private
Fetching project chromeos/overlays/overlay-glimmer-private
Fetching project chromeos/overlays/overlay-celes-cheets-private
Fetching project platform/external/libmojo
Fetching projects:  87% (356/409)  Fetching project chromeos/vendor/qualcomm-sdk
Fetching project chromeos/overlays/overlay-variant-veyron-jerry-private
Fetching project chromiumos/third_party/marvell
Fetching project chromeos/overlays/overlay-asuka-private
Fetching projects:  88% (360/409)  Fetching project chromiumos/third_party/ltp
Fetching project chromeos/overlays/overlay-sumo-private
Fetching project chromeos/overlays/overlay-butterfly-private
Fetching project chromeos/ap/wireless
Fetching project chromium/tools/depot_tools
Fetching projects:  89% (365/409)  Fetching project chromeos/overlays/overlay-variant-peach-pi-private
Fetching project chromeos/overlays/overlay-expresso-private
Fetching project chromeos/overlays/overlay-auron-private
Fetching project chromiumos/third_party/libqmi
Fetching projects:  90% (369/409)  Fetching project chromiumos/third_party/bluez
Fetching project chromeos/chromeos-hwid
Fetching project chromiumos/platform/monitor_reconfig
Fetching project chromiumos/third_party/daisydog
Fetching projects:  91% (373/409)  Fetching project chromeos/overlays/overlay-variant-guado-moblab-private
Fetching project chromeos/overlays/overlay-variant-falco-li-private
Fetching project aosp/platform/system/webservd
Fetching project chromeos/overlays/project-labstation-private
Fetching projects:  92% (377/409)  Fetching project chromeos/overlays/overlay-pbody-private
Fetching project chromiumos/third_party/cryptoc
Fetching project chromiumos/third_party/hostap
Fetching project chromeos/overlays/overlay-oak-cheets-private
Fetching projects:  93% (381/409)  Fetching project chromeos/overlays/overlay-lakitu-private
Fetching project chromiumos/platform/touch_firmware_test
Fetching project chromeos/third_party/speech-micro
Fetching project chromiumos/platform/mosys
Fetching projects:  94% (385/409)  Fetching project chromeos/overlays/overlay-variant-veyron-minnie-cheets-private
Fetching project chromeos/vendor/gobi3k-lib
Fetching project chromiumos/platform/touch_updater
Fetching project chromiumos/platform/initramfs
Fetching projects:  95% (389/409)  Fetching project chromiumos/third_party/whining
remote: Total 0 (delta 0), reused 0 (delta 0)        
Fetching project chromeos/overlays/overlay-chell-private
Fetching project chromeos/overlays/overlay-variant-lemmings-external-private
Fetching project chromeos/vendor/fingerprints-hal
Fetching projects:  96% (393/409)  Fetching project chromeos/lakitu/spiny
Fetching project chromiumos/third_party/seabios
Fetching projects:  98% (401/409)  Fetching project chromiumos/third_party/kernel
Fetching project chromiumos/third_party/kernel
Fetching projects:  99% (405/409)  Fetching project chromiumos/third_party/kernel
Fetching project chromiumos/third_party/kernel
fatal: remote error: Access denied to jashur@google.com
fatal: remote error: Access denied to jashur@google.com
error: Cannot fetch chrome/tools/build
warn: --force-broken, continuing to sync
error: Cannot fetch chrome/tools/release
warn: --force-broken, continuing to sync
Fetching projects: 100% (409/409)  
error: Exited sync due to fetch errors

Comment 29 by ayatane@chromium.org, Jan 12 2017 

Can you repo upload now?  The repo sync -f should have updated the repositories needed by repo upload.

You should file a separate bug for the permission errors you are getting after a few weeks and cc @krisr for what he did to set up the new repo.

Comment 30 by jashur@chromium.org, Jan 12 2017 

Yes, I'll file a separate bug for the permission errors.

After running repo sync . -f and running repo upload . I am receiving the same output as before:

jashur@jashur:~/lab/chromeos-admin/puppet/modules/lab/files/dhcp-server$ repo upload .
Run hook scripts from https://chrome-internal.googlesource.com/chromeos/manifest-internal.git (yes/always/NO)? yes

Errors in PROJECT *chromeos/chromeos-admin*!
    COMMIT 2958cd2b:
        Description:
            >Adding temp space for chromeos1 devserver build
            >
            >BUG=None
            >TEST=presubmit passes
            >
            >Change-Id: I8c0d41b176aec00db4819611824222bf80084ab0
            >
            >
        Errors:
            * Hook script "./bin/run_tests" failed with code 1:
              Creating or updating virtualenv in /usr/local/google/home/jashur/lab/chromeos-admin/bin/.venv
              New python executable in /usr/local/google/home/jashur/lab/chromeos-admin/bin/.venv/bin/python
              Installing setuptools, pip...done.
              Ignoring indexes: https://pypi.python.org/simple
              Requirement already satisfied (use --upgrade to upgrade): setuptools==28.2.0 in ./.venv/lib/python2.7/site-packages
              Ignoring indexes: https://pypi.python.org/simple
              Requirement already satisfied (use --upgrade to upgrade): pip==8.1.2 in ./.venv/lib/python2.7/site-packages
              Ignoring indexes: https://pypi.python.org/simple
              Obtaining file:///usr/local/google/home/jashur/lab/chromeos-admin/cros-admin (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 1))
              Obtaining file:///usr/local/google/home/jashur/lab/chromeos-admin/vagrant-test (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 2))
              Obtaining file:///usr/local/google/home/jashur/lab/chromeos-admin/server-management-lib (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 3))
              Collecting contextlib2==0.5.4 (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 4))
                Could not find a version that satisfies the requirement contextlib2==0.5.4 (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 4)) (from versions: )
              No matching distribution found for contextlib2==0.5.4 (from -r /usr/local/google/home/jashur/lab/chromeos-admin/bin/requirements.txt (line 4))
              

Preupload failed due to errors in project(s). HINTS:
- To disable some source style checks, and for other hints, see <checkout_dir>/src/repohooks/README
- To upload only current project, run 'repo upload .'

Comment 31 by ayatane@chromium.org, Jan 12 2017 

Looks like the -f will still skip the sync step, but it is fetching all of the needed repos.  If the documentation is to be believed, you can run this now:

cd /usr/local/google/home/jashur/lab && repo sync -l

(This will probably print some errors that you can ignore.)

It will update the local work tree with the fetched commits and repo upload should work.

Comment 32 by jashur@chromium.org, Jan 12 2017 

This worked! But is this just a temp fix or should something further be done to resolve the issue completely?

Comment 33 by ayatane@chromium.org, Jan 12 2017 

You will need a fix for the other bug.  In the meantime, the repo sync -f followed by repo sync -l should work.

Standard procedure should be to run repo sync regularly to update everything.  The workaround should update almost everything which should be enough for any changes the lab depends on, but I can't guarantee it.

Comment 34 by ayatane@chromium.org, Jan 12 2017

Status: Verified (was: Untriaged)
►

Sign in to add a comment