Look here: https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/76621 And more specifically at content_browsertests: https://build.chromium.org/p/tryserver.chromium.android/builders/linux_android_rel_ng/builds/76621/steps/content_browsertests%20%28with%20patch%29%20on%20Android/logs/stdio Notice that 5 tests failed consistently, but at the end of the output, it reported all passed. This leads to the bot being able to show up green even when tests fail. This doesn't seem right.
This is a relatively recent regression in the test runner.
(specifically, I introduced it on Monday in https://codereview.chromium.org/1987763002)
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/f7461118211ccac06090eb8b70d25c52aa314a1b commit f7461118211ccac06090eb8b70d25c52aa314a1b Author: jbudorick <jbudorick@chromium.org> Date: Fri May 27 04:30:49 2016 [Android] Fix unknown handling in gtest_test_instance. BUG= 615086 ,615291 TBR=dewittj@chromium.org Review-Url: https://codereview.chromium.org/2014333002 Cr-Commit-Position: refs/heads/master@{#396378} [modify] https://crrev.com/f7461118211ccac06090eb8b70d25c52aa314a1b/build/android/pylib/gtest/gtest_test_instance.py [modify] https://crrev.com/f7461118211ccac06090eb8b70d25c52aa314a1b/build/android/pylib/gtest/gtest_test_instance_test.py [modify] https://crrev.com/f7461118211ccac06090eb8b70d25c52aa314a1b/build/android/pylib/local/device/local_device_gtest_run.py [modify] https://crrev.com/f7461118211ccac06090eb8b70d25c52aa314a1b/build/android/pylib/remote/device/remote_device_gtest_run.py [modify] https://crrev.com/f7461118211ccac06090eb8b70d25c52aa314a1b/content/browser/download/mhtml_generation_browsertest.cc
Comment 1 by paulmeyer@chromium.org
, May 26 2016