(CIPD is not related at all)

numpy version was updated to the latest version in crbug.com/674305 because SciPy version used depends on numpy >= 1.7.1 (see "Requires Distributions" in https://pypi.python.org/pypi/scipy/0.18.1).

We can try to rollback scipy and numpy versions to old ones, but this is unstable solution (eventually someone will need a feature not available in prehistoric versions).

I don't know a better non-hacky solution.

(sorry, I thought those packages are managed by CIPD)

One possible non-hacky solution is to use different set of pinned python packages for GAE environment (or even for each individual GAE app), and pin numpy to 1.6.1 there. Perhaps using new vpython tool dnj@ is developing.

This will require some work to hook this up to test.py, tryjobs, CI bots, etc.

Where is this code being run? Is it run on bots, or on developer systems?

One possible plan would be:
1) Define a VirtualEnv spec w/ the same set of libraries that GAE has.
2) Bootstrap all Infra GAE tests through this VirtualEnv.

This would actually be really cool precursor to:
*) Bootstrap all Infra tests through some sort of VirtualEnv :)

The code is running on my local workstation when I try to launch Findit app with google_appengine/dev_appserver.py

For unittests run with test.py, there is no such error locally on my workstation or on tryjobs/CI.
It seems GAE dev_appserver has some restriction to not load ctypes or _ctypes at runtime.

Findit only depends on numpy.percentile, and I have a workaround for it.
So please feel free to consider this low priority if too much work is needed.

I like the idea of vPython through VirtualEnv here. It is really cool!

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra/+/2ae7c546f4e3c038d3157ac69be7ca70552c323f

commit 2ae7c546f4e3c038d3157ac69be7ca70552c323f
Author: Shuotao Gao <stgao@chromium.org>
Date: Wed May 10 18:39:12 2017

[Findit] Workaround numpy import to run Findit app locally on dev_appserver.

BUG=720186

Change-Id: Iafa7acd6c60a5669ed500b5b2f53e7d6d92c7ffd
Reviewed-on: https://chromium-review.googlesource.com/501353
Commit-Queue: Shuotao Gao <stgao@chromium.org>
Reviewed-by: Jeffrey Li <lijeffrey@chromium.org>
Reviewed-by: Chan Li <chanli@chromium.org>
Reviewed-by: Roberto Carrillo <robertocn@chromium.org>

[modify] https://crrev.com/2ae7c546f4e3c038d3157ac69be7ca70552c323f/appengine/findit/handlers/auto_revert_metrics.py
[modify] https://crrev.com/2ae7c546f4e3c038d3157ac69be7ca70552c323f/appengine/findit/util_scripts/run.sh

This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Due to the version mismatch between numpy in infra/ENV and the one in GAE, it is quite easy to use a function in 1.11.0 which is not available in the version in GAE.

Does numpy require a C extension or can it run as a pure python module? Because if it's pure python, you could "unmap" the GAE provided version and use yours.

We checked and found that numpy requires C extension. So we could not go with an "unmap".

I'm afraid there isn't much FOundations team can do for you here:
Theoretically, you could configure your own .vpython file and stick it into your root of your appengine app AND:
 * ensure that devappserver runs with PYTHONPATH set to .vpython's virtual env.
 * modify infra/infra repo TRY and CI recipe to:
   * exclude appengine/findit from Python appengine apps tested normally
   * add special invocation for tests inside appengine/findit
 * keep your own .vpython up to date with whatever is in root infra/infra .vpython so you don't miss out on updates to infra_libs and other packages.

+iannucci to confirm/deny/offer better suggestions.