New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 842698 link

Starred by 2 users

Issue metadata

Status: Fixed
Owner:
Closed: May 2018
Cc:
EstimatedDays: ----
NextAction: ----
OS: Android
Pri: 3
Type: Bug

Blocked on:
issue 843038
issue 845816

Blocking:
issue 843511
issue 840756



Sign in to add a comment

Reduce number of excluded tests from chromium.android bots.

Project Member Reported by h...@chromium.org, May 14 2018

Issue description

There are many tests excluded from running on chromium.android bots, even though they should pass.

This bug tracks getting them re-enabled, fixing, or properly disabling them.
 
Project Member

Comment 1 by bugdroid1@chromium.org, May 14 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/0ef6c52b5ee4cc5ba76328bbcd2b6712042bbacd

commit 0ef6c52b5ee4cc5ba76328bbcd2b6712042bbacd
Author: Hans Wennborg <hans@chromium.org>
Date: Mon May 14 16:51:14 2018

Android test exclusions: don't exclude blink_heap_unittests

The test does pass on some bots, e.g. [1], and it's not clear
why it was being excluded. If there's a legitimate reason for it
not running on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the test to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

Change-Id: Ib7fdf46abf1ddf6b9fdb63c908c1f35040e4d468
Reviewed-on: https://chromium-review.googlesource.com/1057727
Commit-Queue: Hans Wennborg <hans@chromium.org>
Commit-Queue: Nico Weber <thakis@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#558341}
[modify] https://crrev.com/0ef6c52b5ee4cc5ba76328bbcd2b6712042bbacd/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/0ef6c52b5ee4cc5ba76328bbcd2b6712042bbacd/testing/buildbot/chromium.android.json
[modify] https://crrev.com/0ef6c52b5ee4cc5ba76328bbcd2b6712042bbacd/testing/buildbot/test_suite_exceptions.pyl

Comment 2 by h...@chromium.org, May 15 2018

Blockedon: 843038
Project Member

Comment 3 by bugdroid1@chromium.org, May 15 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/c8f3f9b74ea46af2cded08c530cc67c52efd48cf

commit c8f3f9b74ea46af2cded08c530cc67c52efd48cf
Author: Hans Wennborg <hans@chromium.org>
Date: Tue May 15 15:24:39 2018

testing: Move gin_unittests to non_android_chromium_gtests

It's already excluded manually from almost all Android bots in
test_suite_exceptions.pyl, and fails if we try to run it on [1].

It seems this test simply does not reliably work on Android, and
so excluding it by default makes more sense.

For some reason, this move also enables it on some chromium.clang
bots. I'm not sure whether disabling it for those bots was intentional,
but we'll find out.

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

Bug:  840756 ,  842698 ,  843124 
Change-Id: I4c40bbfe66943ad77e6f970f4ca3fa1a218166d3
Reviewed-on: https://chromium-review.googlesource.com/1059514
Commit-Queue: Hans Wennborg <hans@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#558709}
[modify] https://crrev.com/c8f3f9b74ea46af2cded08c530cc67c52efd48cf/testing/buildbot/chromium.android.json
[modify] https://crrev.com/c8f3f9b74ea46af2cded08c530cc67c52efd48cf/testing/buildbot/chromium.clang.json
[modify] https://crrev.com/c8f3f9b74ea46af2cded08c530cc67c52efd48cf/testing/buildbot/chromium.fyi.json
[modify] https://crrev.com/c8f3f9b74ea46af2cded08c530cc67c52efd48cf/testing/buildbot/chromium.memory.json
[modify] https://crrev.com/c8f3f9b74ea46af2cded08c530cc67c52efd48cf/testing/buildbot/test_suite_exceptions.pyl
[modify] https://crrev.com/c8f3f9b74ea46af2cded08c530cc67c52efd48cf/testing/buildbot/test_suites.pyl

Project Member

Comment 4 by bugdroid1@chromium.org, May 15 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/5ba8e28179646b2c24edf2a01a6da9364d331c87

commit 5ba8e28179646b2c24edf2a01a6da9364d331c87
Author: Hans Wennborg <hans@chromium.org>
Date: Tue May 15 15:40:57 2018

testing: Move service_manager_unittests to non_android_chromium_gtests

It's already excluded manually from almost all Android bots.

For some reason this also enables it on some chromium.clang and
chromium.memory bots. If it turns out to fail there, we can add
exclusions.

Bug:  842698 ,  840756 , 843134
Change-Id: I6c119b5272163a41676f1a0f8b7a2081631c9564
Reviewed-on: https://chromium-review.googlesource.com/1059780
Reviewed-by: Nico Weber <thakis@chromium.org>
Commit-Queue: Hans Wennborg <hans@chromium.org>
Cr-Commit-Position: refs/heads/master@{#558716}
[modify] https://crrev.com/5ba8e28179646b2c24edf2a01a6da9364d331c87/testing/buildbot/chromium.android.json
[modify] https://crrev.com/5ba8e28179646b2c24edf2a01a6da9364d331c87/testing/buildbot/chromium.clang.json
[modify] https://crrev.com/5ba8e28179646b2c24edf2a01a6da9364d331c87/testing/buildbot/chromium.fyi.json
[modify] https://crrev.com/5ba8e28179646b2c24edf2a01a6da9364d331c87/testing/buildbot/chromium.memory.json
[modify] https://crrev.com/5ba8e28179646b2c24edf2a01a6da9364d331c87/testing/buildbot/test_suite_exceptions.pyl
[modify] https://crrev.com/5ba8e28179646b2c24edf2a01a6da9364d331c87/testing/buildbot/test_suites.pyl

Project Member

Comment 5 by bugdroid1@chromium.org, May 15 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/0c5ac9192f7f5f23c41f51fcf918326920ddc2ac

commit 0c5ac9192f7f5f23c41f51fcf918326920ddc2ac
Author: Hans Wennborg <hans@chromium.org>
Date: Tue May 15 17:02:53 2018

media_blink_unittests: Exclude KeySystemConfigSelectorTest on Android

Bug:  608541 ,  840756 ,  842698 
Change-Id: Iaaaf79dc775a6738cff55037ee9c6ff354530e19
Reviewed-on: https://chromium-review.googlesource.com/1059655
Reviewed-by: Nico Weber <thakis@chromium.org>
Reviewed-by: Frank Liberato <liberato@chromium.org>
Commit-Queue: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#558755}
[modify] https://crrev.com/0c5ac9192f7f5f23c41f51fcf918326920ddc2ac/media/blink/BUILD.gn

Project Member

Comment 7 by bugdroid1@chromium.org, May 16 2018

Comment 8 by thakis@chromium.org, May 16 2018

Blocking: 843511
Project Member

Comment 9 by bugdroid1@chromium.org, May 16 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/ca93d76ba7ab8fbd034029ef4bac2191d54888f6

commit ca93d76ba7ab8fbd034029ef4bac2191d54888f6
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 16 11:57:57 2018

Android test exclusions: don't exclude boringssl_ssl_tests

These tests do pass on some bots, e.g. [1], and it's not clear why they were
being excluded. If there's a legitimate reason for them not to run on Android,
let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots, please
file a bug with information about the error, put the exclusion back and
reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

Change-Id: I361dc479f0e8bdb1054107bc9caf60b476608116
Reviewed-on: https://chromium-review.googlesource.com/1061253
Reviewed-by: Nico Weber <thakis@chromium.org>
Commit-Queue: Hans Wennborg <hans@chromium.org>
Cr-Commit-Position: refs/heads/master@{#559044}
[modify] https://crrev.com/ca93d76ba7ab8fbd034029ef4bac2191d54888f6/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/ca93d76ba7ab8fbd034029ef4bac2191d54888f6/testing/buildbot/chromium.android.json
[modify] https://crrev.com/ca93d76ba7ab8fbd034029ef4bac2191d54888f6/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 10 by bugdroid1@chromium.org, May 16 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/f4e9e18bbaa49760ad46733c8053fa71f88b3742

commit f4e9e18bbaa49760ad46733c8053fa71f88b3742
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 16 12:06:12 2018

Android test exclusions: don't exclude boringssl_crypto_tests

These tests do pass on some bots, e.g. [1], and it's not clear why they were
being excluded. If there's a legitimate reason for them not to run on Android,
let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots, please
file a bug with information about the error, put the exclusion back and
reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

Change-Id: I6e6e5acba61aa3f48bdf4770d6deab998f4723f3
Reviewed-on: https://chromium-review.googlesource.com/1061233
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#559047}
[modify] https://crrev.com/f4e9e18bbaa49760ad46733c8053fa71f88b3742/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/f4e9e18bbaa49760ad46733c8053fa71f88b3742/testing/buildbot/chromium.android.json
[modify] https://crrev.com/f4e9e18bbaa49760ad46733c8053fa71f88b3742/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 11 by bugdroid1@chromium.org, May 16 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/d2252c8f079a30c12b901a70496d68ac38e865d4

commit d2252c8f079a30c12b901a70496d68ac38e865d4
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 16 12:19:30 2018

Android test exclusions: don't exclude display_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they were
being excluded. If there's a legitimate reason for them not to run on Android,
let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots, please
file a bug with information about the error, put the exclusion back and
reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

Change-Id: I3d407c60b853ce62c37d00d97673d18e9b288b24
Reviewed-on: https://chromium-review.googlesource.com/1061236
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#559049}
[modify] https://crrev.com/d2252c8f079a30c12b901a70496d68ac38e865d4/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/d2252c8f079a30c12b901a70496d68ac38e865d4/testing/buildbot/chromium.android.json
[modify] https://crrev.com/d2252c8f079a30c12b901a70496d68ac38e865d4/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 12 by bugdroid1@chromium.org, May 16 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/725c78df145b85c1d6797d9b1d798728417cae0d

commit 725c78df145b85c1d6797d9b1d798728417cae0d
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 16 12:30:49 2018

Android test exclusions: don't exclude components_background_task_scheduler_junit_tests

These tests do pass on some bots, e.g. [1], and it's not clear why they were
being excluded. If there's a legitimate reason for them not to run on Android,
let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots, please
file a bug with information about the error, put the exclusion back and
reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

Change-Id: Iee4f0a51ee32cc66d4a56620d181d2f090486041
Reviewed-on: https://chromium-review.googlesource.com/1061235
Reviewed-by: Nico Weber <thakis@chromium.org>
Commit-Queue: Hans Wennborg <hans@chromium.org>
Cr-Commit-Position: refs/heads/master@{#559052}
[modify] https://crrev.com/725c78df145b85c1d6797d9b1d798728417cae0d/testing/buildbot/chromium.android.json
[modify] https://crrev.com/725c78df145b85c1d6797d9b1d798728417cae0d/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 13 by bugdroid1@chromium.org, May 16 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/131da7189ae82403c9c393dfd3fe9cf5f0390984

commit 131da7189ae82403c9c393dfd3fe9cf5f0390984
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 16 13:38:14 2018

Android test exclusions: don't exclude gfx_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they were
being excluded. If there's a legitimate reason for them not to run on Android,
let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots, please
file a bug with information about the error, put the exclusion back and
reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

Change-Id: I676ea2ab347f2ff837d5b416ffc2df3a7bff13d4
Reviewed-on: https://chromium-review.googlesource.com/1061237
Commit-Queue: Hans Wennborg <hans@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#559065}
[modify] https://crrev.com/131da7189ae82403c9c393dfd3fe9cf5f0390984/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/131da7189ae82403c9c393dfd3fe9cf5f0390984/testing/buildbot/chromium.android.json
[modify] https://crrev.com/131da7189ae82403c9c393dfd3fe9cf5f0390984/testing/buildbot/chromium.win.json
[modify] https://crrev.com/131da7189ae82403c9c393dfd3fe9cf5f0390984/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 14 by bugdroid1@chromium.org, May 16 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/6ec6070736f62073f74478aeda1052a2589865b2

commit 6ec6070736f62073f74478aeda1052a2589865b2
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 16 20:30:30 2018

jingle_unittests: Don't run LibjingleLogTest on Android

Those tests don't pass, but the rest of jingle_unittests seems to do so.

Bug: 843104,  840756 ,  842698 
Change-Id: I9895fa88042ec5decdc70e33fceb362d14638f1d
Reviewed-on: https://chromium-review.googlesource.com/1059613
Reviewed-by: Nico Weber <thakis@chromium.org>
Reviewed-by: Nicolas Zea <zea@chromium.org>
Commit-Queue: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#559266}
[modify] https://crrev.com/6ec6070736f62073f74478aeda1052a2589865b2/jingle/BUILD.gn

Project Member

Comment 16 by bugdroid1@chromium.org, May 17 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/f666fb8e5341331bb42121f28d1322494bd07f7d

commit f666fb8e5341331bb42121f28d1322494bd07f7d
Author: Hans Wennborg <hans@chromium.org>
Date: Thu May 17 13:50:05 2018

Android test exclusions: don't exclude libjingle_xmpp_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they were
being excluded. If there's a legitimate reason for them not to run on Android,
let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots, please
file a bug with information about the error, put the exclusion back and
reference the bug.

(This also enables the test on two chromiumos bots. Presumably it passes
there too.)

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=kbr@chromium.org, thakis@chromium.org

Change-Id: I4f3febe1247d12a3a19f4f1455bc8c841af52628
Reviewed-on: https://chromium-review.googlesource.com/1063830
Commit-Queue: Nico Weber <thakis@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#559513}
[modify] https://crrev.com/f666fb8e5341331bb42121f28d1322494bd07f7d/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/f666fb8e5341331bb42121f28d1322494bd07f7d/testing/buildbot/chromium.android.json
[modify] https://crrev.com/f666fb8e5341331bb42121f28d1322494bd07f7d/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 17 by bugdroid1@chromium.org, May 17 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/9b822f03e769c09a8c22a20cd26bcd0386aeb245

commit 9b822f03e769c09a8c22a20cd26bcd0386aeb245
Author: Hans Wennborg <hans@chromium.org>
Date: Thu May 17 13:52:52 2018

Android test exclusions: don't exclude google_apis_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they were
being excluded. If there's a legitimate reason for them not to run on Android,
let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots, please
file a bug with information about the error, put the exclusion back and
reference the bug.

(This also enables it on a Windows and some Cast bots; it probably passes
on those too.)

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=kbr@chromium.org, thakis@chromium.org

Change-Id: I28c59b515fbbd757783ab7c8f54f84557b9c0c67
Reviewed-on: https://chromium-review.googlesource.com/1063729
Commit-Queue: Nico Weber <thakis@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#559514}
[modify] https://crrev.com/9b822f03e769c09a8c22a20cd26bcd0386aeb245/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/9b822f03e769c09a8c22a20cd26bcd0386aeb245/testing/buildbot/chromium.android.json
[modify] https://crrev.com/9b822f03e769c09a8c22a20cd26bcd0386aeb245/testing/buildbot/chromium.linux.json
[modify] https://crrev.com/9b822f03e769c09a8c22a20cd26bcd0386aeb245/testing/buildbot/chromium.win.json
[modify] https://crrev.com/9b822f03e769c09a8c22a20cd26bcd0386aeb245/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 18 by bugdroid1@chromium.org, May 17 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/78599b5331d91a277fc2e225bee877be5ed759fc

commit 78599b5331d91a277fc2e225bee877be5ed759fc
Author: Hans Wennborg <hans@chromium.org>
Date: Thu May 17 14:35:28 2018

Android test exclusions: don't exclude latency_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they were
being excluded. If there's a legitimate reason for them not to run on Android,
let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots, please
file a bug with information about the error, put the exclusion back and
reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=kbr@chromium.org, thakis@chromium.org

Change-Id: I6bbb04f101ce72636ba0d9c151551a42b0480281
Reviewed-on: https://chromium-review.googlesource.com/1063756
Commit-Queue: Hans Wennborg <hans@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#559528}
[modify] https://crrev.com/78599b5331d91a277fc2e225bee877be5ed759fc/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/78599b5331d91a277fc2e225bee877be5ed759fc/testing/buildbot/chromium.android.json
[modify] https://crrev.com/78599b5331d91a277fc2e225bee877be5ed759fc/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 19 by bugdroid1@chromium.org, May 17 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/70fa918b43be1927db046a9e437bcc20ca430fca

commit 70fa918b43be1927db046a9e437bcc20ca430fca
Author: Hans Wennborg <hans@chromium.org>
Date: Thu May 17 14:36:50 2018

Android test exclusions: don't exclude mojo_test_apk

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=kbr@chromium.org, thakis@chromium.org

Change-Id: Ia3735e9ce17759f62b823eb5df3907f00547786c
Reviewed-on: https://chromium-review.googlesource.com/1063833
Commit-Queue: Nico Weber <thakis@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#559529}
[modify] https://crrev.com/70fa918b43be1927db046a9e437bcc20ca430fca/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/70fa918b43be1927db046a9e437bcc20ca430fca/testing/buildbot/chromium.android.json
[modify] https://crrev.com/70fa918b43be1927db046a9e437bcc20ca430fca/testing/buildbot/chromium.fyi.json
[modify] https://crrev.com/70fa918b43be1927db046a9e437bcc20ca430fca/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 20 by bugdroid1@chromium.org, May 17 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/31fa6fcacd98f4268ef84ac0d284781e5a9c2398

commit 31fa6fcacd98f4268ef84ac0d284781e5a9c2398
Author: Hans Wennborg <hans@chromium.org>
Date: Thu May 17 16:58:16 2018

Android test exclusions: don't exclude midi_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

(Disabling MidiManagerTest.CreatePlatformMidiManager, see second bug.)

Bug:  842698 , 844027

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=kbr@chromium.org, thakis@chromium.org
TBR=toyoshim for media/midi

Change-Id: I5f6e04f97ede67ba37ea3c04063d36ffa8f5e1b6
Reviewed-on: https://chromium-review.googlesource.com/1063832
Reviewed-by: Hans Wennborg <hans@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Commit-Queue: Hans Wennborg <hans@chromium.org>
Cr-Commit-Position: refs/heads/master@{#559573}
[modify] https://crrev.com/31fa6fcacd98f4268ef84ac0d284781e5a9c2398/media/midi/midi_manager_unittest.cc
[modify] https://crrev.com/31fa6fcacd98f4268ef84ac0d284781e5a9c2398/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/31fa6fcacd98f4268ef84ac0d284781e5a9c2398/testing/buildbot/chromium.android.json
[modify] https://crrev.com/31fa6fcacd98f4268ef84ac0d284781e5a9c2398/testing/buildbot/chromium.clang.json
[modify] https://crrev.com/31fa6fcacd98f4268ef84ac0d284781e5a9c2398/testing/buildbot/chromium.memory.json
[modify] https://crrev.com/31fa6fcacd98f4268ef84ac0d284781e5a9c2398/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 21 by bugdroid1@chromium.org, May 22 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/f62ada999bfea530b7746ea50f0d23a12fe33336

commit f62ada999bfea530b7746ea50f0d23a12fe33336
Author: Hans Wennborg <hans@chromium.org>
Date: Tue May 22 13:58:37 2018

Android test exclusions: don't exclude services_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=thakis@chromium.org

Change-Id: I6c2b6a99f064cfe09c8f1843c61d672fad8f0725
Reviewed-on: https://chromium-review.googlesource.com/1068912
Reviewed-by: Nico Weber <thakis@chromium.org>
Commit-Queue: Hans Wennborg <hans@chromium.org>
Cr-Commit-Position: refs/heads/master@{#560553}
[modify] https://crrev.com/f62ada999bfea530b7746ea50f0d23a12fe33336/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/f62ada999bfea530b7746ea50f0d23a12fe33336/testing/buildbot/chromium.android.json
[modify] https://crrev.com/f62ada999bfea530b7746ea50f0d23a12fe33336/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 22 by bugdroid1@chromium.org, May 22 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/46791aea1ab97f75521abb02942a43e6af16cd7f

commit 46791aea1ab97f75521abb02942a43e6af16cd7f
Author: Hans Wennborg <hans@chromium.org>
Date: Tue May 22 14:27:20 2018

Android test exclusions: don't exclude vr_pixeltests

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=thakis@chromium.org

Change-Id: Iaddef314b335f064a129a34d0eefaf327143e8ec
Reviewed-on: https://chromium-review.googlesource.com/1068743
Reviewed-by: Nico Weber <thakis@chromium.org>
Commit-Queue: Hans Wennborg <hans@chromium.org>
Cr-Commit-Position: refs/heads/master@{#560565}
[modify] https://crrev.com/46791aea1ab97f75521abb02942a43e6af16cd7f/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/46791aea1ab97f75521abb02942a43e6af16cd7f/testing/buildbot/chromium.android.json
[modify] https://crrev.com/46791aea1ab97f75521abb02942a43e6af16cd7f/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 23 by bugdroid1@chromium.org, May 22 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/98e04370395743cf23bd5372195ccacece68b6bb

commit 98e04370395743cf23bd5372195ccacece68b6bb
Author: Hans Wennborg <hans@chromium.org>
Date: Tue May 22 14:54:02 2018

Android test exclusions: don't exclude skia_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

(Also enable on the Cast bots while we're here.)

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=thakis@chromium.org

Change-Id: If2704b5c0dee5d37677a209b31febed3785cc3e3
Reviewed-on: https://chromium-review.googlesource.com/1068913
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#560583}
[modify] https://crrev.com/98e04370395743cf23bd5372195ccacece68b6bb/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/98e04370395743cf23bd5372195ccacece68b6bb/testing/buildbot/chromium.android.json
[modify] https://crrev.com/98e04370395743cf23bd5372195ccacece68b6bb/testing/buildbot/chromium.linux.json
[modify] https://crrev.com/98e04370395743cf23bd5372195ccacece68b6bb/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 24 by bugdroid1@chromium.org, May 22 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/ecaf8c624025b3f1b64c140d3663d8789662a147

commit ecaf8c624025b3f1b64c140d3663d8789662a147
Author: Hans Wennborg <hans@chromium.org>
Date: Tue May 22 14:56:09 2018

Android test exclusions: don't exclude url_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=thakis@chromium.org

Change-Id: I3ded23d8735a677e04dde3e957bf26e131f56941
Reviewed-on: https://chromium-review.googlesource.com/1068738
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#560585}
[modify] https://crrev.com/ecaf8c624025b3f1b64c140d3663d8789662a147/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/ecaf8c624025b3f1b64c140d3663d8789662a147/testing/buildbot/chromium.android.json
[modify] https://crrev.com/ecaf8c624025b3f1b64c140d3663d8789662a147/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 25 by bugdroid1@chromium.org, May 22 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/c24ad0015be90c0103ab618551ee5621ddef4def

commit c24ad0015be90c0103ab618551ee5621ddef4def
Author: Hans Wennborg <hans@chromium.org>
Date: Tue May 22 15:09:18 2018

Remove test exceptions for renderer-side navigation

These tests don't actually exist anymore; only the exceptions were left.

R=thakis@chromium.org

Bug: 789577,  842698 
Change-Id: I649f4ce44129e4b659e3801aad2f9ee296378dd3
Reviewed-on: https://chromium-review.googlesource.com/1068910
Reviewed-by: Nico Weber <thakis@chromium.org>
Commit-Queue: Hans Wennborg <hans@chromium.org>
Cr-Commit-Position: refs/heads/master@{#560590}
[modify] https://crrev.com/c24ad0015be90c0103ab618551ee5621ddef4def/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 26 by bugdroid1@chromium.org, May 23 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/d5453f7205de7ab052982d919823b08af3cd1698

commit d5453f7205de7ab052982d919823b08af3cd1698
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 23 06:56:46 2018

Android test exclusions: don't exclude wtf_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=thakis@chromium.org

Change-Id: I39bb8f5b82392e1043b748c8e3cefb7ac5741616
Reviewed-on: https://chromium-review.googlesource.com/1068874
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#560979}
[modify] https://crrev.com/d5453f7205de7ab052982d919823b08af3cd1698/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/d5453f7205de7ab052982d919823b08af3cd1698/testing/buildbot/chromium.android.json
[modify] https://crrev.com/d5453f7205de7ab052982d919823b08af3cd1698/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 27 by bugdroid1@chromium.org, May 23 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/34037a3b48a18a65286e80247ae7f9b82d02ea01

commit 34037a3b48a18a65286e80247ae7f9b82d02ea01
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 23 06:58:34 2018

Android test exclusions: don't exclude viz_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=thakis@chromium.org

Change-Id: I9a5cdf61e6b001cf8dae6cab3eee457cf74bbf76
Reviewed-on: https://chromium-review.googlesource.com/1068741
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#560980}
[modify] https://crrev.com/34037a3b48a18a65286e80247ae7f9b82d02ea01/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/34037a3b48a18a65286e80247ae7f9b82d02ea01/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 28 by bugdroid1@chromium.org, May 23 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/02d4adb26962c68888452399eceea9f81fba1da0

commit 02d4adb26962c68888452399eceea9f81fba1da0
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 23 07:00:30 2018

Android test exclusions: don't exclude vr_common_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=thakis@chromium.org

Change-Id: I20af35b11d3e538250fd2eea406f4c22e5d6bd42
Reviewed-on: https://chromium-review.googlesource.com/1068871
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#560981}
[modify] https://crrev.com/02d4adb26962c68888452399eceea9f81fba1da0/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/02d4adb26962c68888452399eceea9f81fba1da0/testing/buildbot/chromium.android.json
[modify] https://crrev.com/02d4adb26962c68888452399eceea9f81fba1da0/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 29 by bugdroid1@chromium.org, May 23 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/5d675f772503003ade32a3a0ac32a69c97a2384b

commit 5d675f772503003ade32a3a0ac32a69c97a2384b
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 23 10:14:17 2018

Android test exclusions: don't exclude webkit_unit_tests

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Disable ProtocolParserTest.Reading on Android until it's fixed,
see the third bug.

(The CrOS failure was fixed a few months ago, see  crbug.com/795645 )

Bug:  842698 ,  795645 ,  845816 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=thakis@chromium.org

Change-Id: I4c683170508d431864880774543f942cf7446b88
Reviewed-on: https://chromium-review.googlesource.com/1068873
Commit-Queue: Hans Wennborg <hans@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#561021}
[modify] https://crrev.com/5d675f772503003ade32a3a0ac32a69c97a2384b/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/5d675f772503003ade32a3a0ac32a69c97a2384b/testing/buildbot/chromium.android.json
[modify] https://crrev.com/5d675f772503003ade32a3a0ac32a69c97a2384b/testing/buildbot/chromium.chromiumos.json
[modify] https://crrev.com/5d675f772503003ade32a3a0ac32a69c97a2384b/testing/buildbot/test_suite_exceptions.pyl
[modify] https://crrev.com/5d675f772503003ade32a3a0ac32a69c97a2384b/third_party/blink/renderer/core/inspector/protocol_parser_test.cc

Project Member

Comment 30 by bugdroid1@chromium.org, May 23 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/95d2e3b598c81a7c5fe7216999e23cf98662b52b

commit 95d2e3b598c81a7c5fe7216999e23cf98662b52b
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 23 14:26:05 2018

Android test exclusions: don't exclude chrome_public_test_vr_apk

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=kbr@chromium.org, thakis@chromium.org

Change-Id: I55eab1ee93af85ee1922179f62be17f417ac5bc9
Reviewed-on: https://chromium-review.googlesource.com/1070140
Commit-Queue: Nico Weber <thakis@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#561069}
[modify] https://crrev.com/95d2e3b598c81a7c5fe7216999e23cf98662b52b/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/95d2e3b598c81a7c5fe7216999e23cf98662b52b/testing/buildbot/chromium.android.json
[modify] https://crrev.com/95d2e3b598c81a7c5fe7216999e23cf98662b52b/testing/buildbot/chromium.fyi.json
[modify] https://crrev.com/95d2e3b598c81a7c5fe7216999e23cf98662b52b/testing/buildbot/chromium.memory.json
[modify] https://crrev.com/95d2e3b598c81a7c5fe7216999e23cf98662b52b/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 31 by bugdroid1@chromium.org, May 23 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/aa108127e725d5ecb248e61dddc64ae615ff8b78

commit aa108127e725d5ecb248e61dddc64ae615ff8b78
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 23 14:28:24 2018

Android test exclusions: don't exclude cacheinvalidation_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

Change-Id: I82babdc0b4ce535b0f9758fe95a22ab5ea9b7a47
Reviewed-on: https://chromium-review.googlesource.com/1068884
Commit-Queue: Nico Weber <thakis@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#561072}
[modify] https://crrev.com/aa108127e725d5ecb248e61dddc64ae615ff8b78/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/aa108127e725d5ecb248e61dddc64ae615ff8b78/testing/buildbot/chromium.android.json
[modify] https://crrev.com/aa108127e725d5ecb248e61dddc64ae615ff8b78/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 32 by bugdroid1@chromium.org, May 23 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/288a42348ec79756181a080b04ad17dd013deea2

commit 288a42348ec79756181a080b04ad17dd013deea2
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 23 14:30:48 2018

Android test exclusions: don't exclude crypto_unittests

These tests do pass on some bots, e.g. [1], and it's not clear why they
were being excluded. If there's a legitimate reason for them not to run
on Android, let's figure it out and get a bug filed.

Sheriffs: if this causes the tests to start failing on Android bots,
please file a bug with information about the error, put the exclusion
back and reference the bug.

Bug:  842698 

 [1] https://ci.chromium.org/buildbot/chromium.clang/ToTAndroid/3343

R=kbr@chromium.org, thakis@chromium.org

Change-Id: Icfd0f6ed5535c34fdd01ec4bf090e29e47172dce
Reviewed-on: https://chromium-review.googlesource.com/1068886
Commit-Queue: Nico Weber <thakis@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>
Cr-Commit-Position: refs/heads/master@{#561074}
[modify] https://crrev.com/288a42348ec79756181a080b04ad17dd013deea2/testing/buildbot/chromium.android.fyi.json
[modify] https://crrev.com/288a42348ec79756181a080b04ad17dd013deea2/testing/buildbot/chromium.android.json
[modify] https://crrev.com/288a42348ec79756181a080b04ad17dd013deea2/testing/buildbot/test_suite_exceptions.pyl

Project Member

Comment 33 by bugdroid1@chromium.org, May 23 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/eac4c36cc29599d97925b3f6f8a499f634bee421

commit eac4c36cc29599d97925b3f6f8a499f634bee421
Author: Hans Wennborg <hans@chromium.org>
Date: Wed May 23 16:04:06 2018

Android test exclusions: bug reference for webview_instrumentation_test_apk

These tests genuinely don't pass. Add a bug reference.

TBR=thakis

Bug:  842698 , 824959
Change-Id: Idf96a649265de5135b69f448bf439208b63ecaf9
Reviewed-on: https://chromium-review.googlesource.com/1070143
Reviewed-by: Hans Wennborg <hans@chromium.org>
Cr-Commit-Position: refs/heads/master@{#561110}
[modify] https://crrev.com/eac4c36cc29599d97925b3f6f8a499f634bee421/testing/buildbot/test_suite_exceptions.pyl

Comment 34 by h...@chromium.org, May 24 2018

Status: Fixed (was: Assigned)
That's all I had. webview_instrumentation_test_apk is the only remaining awkward exclusion on Android now.

Comment 35 by kbr@chromium.org, May 26 2018

Fantastic work Hans! Thanks for cleaning up and unifying these test suites.

Blockedon: 845816

Sign in to add a comment