New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 778380 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner:
Last visit > 30 days ago
Closed: Dec 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Daily bandwidth rate limit exceeded from https://chromium.googlesource.com/

Project Member Reported by sbc@chromium.org, Oct 25 2017

Issue description

From the wasm waterfall travis build:

https://travis-ci.org/WebAssembly/waterfall/builds/292736000

Can/should we whitelist the travis IPs somenhow?

```
@@@BUILD_STEP Sync Repos@@@
Cloning Prebuilt Chromium Clang directory
subprocess.check_call(`/usr/bin/git clone https://chromium.googlesource.com/chromium/src/tools/clang.git /home/travis/build/WebAssembly/waterfall/src/work/chromium-clang/tools/clang`, cwd=`/home/travis/build/WebAssembly/waterfall/src`)
Cloning into '/home/travis/build/WebAssembly/waterfall/src/work/chromium-clang/tools/clang'...
remote: Daily bandwidth rate limit exceeded for IP 52.54.31.11
fatal: protocol error: bad pack header
Traceback (most recent call last):
  File "./src/build.py", line 1757, in main
  File "./src/build.py", line 1701, in run
  File "./src/build.py", line 788, in SyncRepos
  File "./src/build.py", line 421, in Sync
  File "./src/build.py", line 500, in SyncToolchain
  File "/home/travis/build/WebAssembly/waterfall/src/host_toolchains.py", line 44, in SyncPrebuiltClang
    proc.check_call(['git', 'clone', git_repo, tools_clang])
  File "/home/travis/build/WebAssembly/waterfall/src/proc.py", line 76, in check_call
    subprocess.check_call(cmd, **kwargs)
  File "/opt/python/2.7.13/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['/usr/bin/git', 'clone', 'https://chromium.googlesource.com/chromium/src/tools/clang.git', '/home/travis/build/WebAssembly/waterfall/src/work/chromium-clang/tools/clang']' returned non-zero exit status 128
```
 

Comment 1 by aga...@chromium.org, Oct 27 2017

Owner: sbc@chromium.org
Status: Assigned (was: Untriaged)
The fact that the bandwidth rate limit was exceeded for a specific IP means that the clone requests are not being made with authentication. If authentication were provided, then both the rate limit would be higher and it would say "rate limit exceeded for <account>".

Before doing any one-shot whitelisting (which is both hard and a Bad Idea), please make sure that the bots are providing authentication credentials when cloning.

Comment 2 by sbc@chromium.org, Oct 27 2017

What kind of authentication are you suggesting?  Is there a pattern for how to do this in travis or someone else you can point to that is already doing it?
I am not familiar with bells and whistles in travis, but if you can deploy a file to travis w/o having this file publicly accessible, you could so smth like this:

create new account, say whatever@gmail.com, then get ~/.gitcookies  for it the usual way, then stick .gitcookies into travis.

YMMV, of course.

Comment 4 by aga...@chromium.org, Dec 12 2017

Status: WontFix (was: Assigned)
Obsolete, travis waterfall no longer failing.

Sign in to add a comment