This seems to only happen for devices that were passed into the test_runner via '--target-devices-file'. Apparently the test runner doesn't apply any needed health checks for the devices read from that file.

I can take this since I introduced that logic.

(sorry, already started working on it & neglected to update the status)

to clarify: I'm working on fixing local_device_environment, not on how DeviceUtils.HealthyDevices handles checking devices when it has a device_arg.

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/18fac5c4bf292cc711aee969b9a88f8d8630e861

commit 18fac5c4bf292cc711aee969b9a88f8d8630e861
Author: catapult-deps-roller <catapult-deps-roller@chromium.org>
Date: Thu Jul 14 01:24:43 2016

Roll src/third_party/catapult/ 7c71d1cba..70cc6874b (4 commits).

https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/7c71d1cba536..70cc6874be5a

$ git log 7c71d1cba..70cc6874b --date=short --no-merges --format='%ad %ae %s'

BUG= 627939 

TBR=catapult-sheriff@chromium.org

Review-Url: https://codereview.chromium.org/2150773002
Cr-Commit-Position: refs/heads/master@{#405387}

[modify] https://crrev.com/18fac5c4bf292cc711aee969b9a88f8d8630e861/DEPS

Still happening: https://chromium-swarm.appspot.com/user/task/30270b4b864bab11

Yeah, I was waiting on the catapult roll last week & forgot about the CL this week. Landing now.

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/84c46fae5808a0a2ac1a851e51208fa9343eaafb

commit 84c46fae5808a0a2ac1a851e51208fa9343eaafb
Author: jbudorick <jbudorick@chromium.org>
Date: Mon Jul 25 21:43:49 2016

[Android] Blacklist devices on failures during environment set up + tear down.

Requires https://codereview.chromium.org/2144103002/

BUG= 627939 

Review-Url: https://codereview.chromium.org/2144823003
Cr-Commit-Position: refs/heads/master@{#407594}

[modify] https://crrev.com/84c46fae5808a0a2ac1a851e51208fa9343eaafb/build/android/pylib/local/device/local_device_environment.py
[modify] https://crrev.com/84c46fae5808a0a2ac1a851e51208fa9343eaafb/build/android/pylib/local/device/local_device_gtest_run.py
[modify] https://crrev.com/84c46fae5808a0a2ac1a851e51208fa9343eaafb/build/android/pylib/local/device/local_device_instrumentation_test_run.py
[modify] https://crrev.com/84c46fae5808a0a2ac1a851e51208fa9343eaafb/build/android/pylib/local/device/local_device_perf_test_run.py
[modify] https://crrev.com/84c46fae5808a0a2ac1a851e51208fa9343eaafb/build/android/pylib/local/device/local_device_test_run.py