Issue 711263  has been merged into this issue.

Wasn't able to find a clear culprit, disabling the tests in http://crrev.com/2815513010.

dpapad@, do you mind taking a look at this?

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/7c5267fb67d3fcb9d8a9f8898e2bce11fcfedb4e

commit 7c5267fb67d3fcb9d8a9f8898e2bce11fcfedb4e
Author: jdoerrie <jdoerrie@chromium.org>
Date: Thu Apr 13 14:04:19 2017

Disable Flaky WebUI Tests

Both SettingsEasyUnlockBrowserTest.EasyUnlock and SettingsUIBrowserTest.All are flaky on Release builds.

TBR=dpapad@chromium.org
BUG=711256

Review-Url: https://codereview.chromium.org/2815513010
Cr-Commit-Position: refs/heads/master@{#464396}

[modify] https://crrev.com/7c5267fb67d3fcb9d8a9f8898e2bce11fcfedb4e/chrome/test/data/webui/settings/easy_unlock_browsertest_chromeos.js
[modify] https://crrev.com/7c5267fb67d3fcb9d8a9f8898e2bce11fcfedb4e/chrome/test/data/webui/settings/settings_ui_browsertest.js

This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Detected 3 new flakes for test/step "SettingsUIBrowserTest.All". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJAsSBUZsYWtlIhlTZXR0aW5nc1VJQnJvd3NlclRlc3QuQWxsDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Random webui_polymer2_interactive_ui_tests flake because they fail to ShowAndFocusNativeWindow() at the beginning of the test (before the test body). Logs seem to indicate this is because OpenWith.exe owns a sticky foreground window (likely from a previous test).

@jam who wrote ShowAndFocusNativeWindow() in interactive_test_utils_win.cc

Example failure :

[ RUN      ] SettingsUIBrowserTest.All
[756:4032:0907/153445.887:WARNING:discovery_network_list_win.cc(195)] Failed to open Wlan client handle: 1062
[756:8464:0907/153445.887:WARNING:chrome_browser_main_win.cc(643)] Command line too long for RegisterApplicationRestart:  --brave-new-test-launcher --cfi-diag=0 --disable-gpu-process-for-dx12-vulkan-info-collection --gtest_also_run_disabled_tests --gtest_filter=SettingsUIBrowserTest.All --single_process --snapshot-output-dir="C:\b\s\w\ioa7egla" --test-launcher-bot-mode --test-launcher-filter-file=../../testing/buildbot/filters/webui_polymer2_interactive_ui_tests.filter --test-launcher-output="C:\b\s\w\itraxcbf\scoped_dir992_21881\results992_16684\test_results.xml" --test-launcher-summary-output="C:\b\s\w\ioa7egla\output.json" --user-data-dir="C:\b\s\w\itraxcbf\scoped_dir992_21881\d992_14026" --disable-offline-auto-reload --enable-blink-features=MojoJSTest --no-first-run --no-default-browser-check --enable-logging=stderr --disable-default-apps --wm-window-animations-disabled --disable-component-update --test-type=browser --force-color-profile=srgb --disable-zero-browsers-open-for-tests --ipc-connection-timeout=30 --allow-file-access-from-files --dom-automation --log-gpu-control-list-decisions --disable-backgrounding-occluded-windows --disable-gl-drawing-for-tests --override-use-software-gl-for-tests --force-color-profile=srgb --disable-compositor-ukm-for-tests --enable-features=TestFeatureForBrowserTest1,WebUIPolymer2 --disable-features=TestFeatureForBrowserTest2 --disable-gpu-process-for-dx12-vulkan-info-collection --flag-switches-begin --flag-switches-end --file-url-path-alias="/gen=C:\b\s\w\ir\out\Release_x64\gen" --restore-last-session about:blank
[756:8464:0907/153446.015:WARNING:gaia_auth_fetcher.cc(991)] Could not reach Google Accounts servers: errno -11
[756:8464:0907/153446.894:WARNING:gaia_auth_fetcher.cc(991)] Could not reach Google Accounts servers: errno -11
[756:8464:0907/153447.145:ERROR:interactive_test_utils_win.cc(67)] ShowAndFocusNativeWindow failed. foreground window: 00000000097403F6, title: , path: C:\Windows\System32\OpenWith.exe
../../chrome/test/base/in_process_browser_test.cc(506): error: Value of: global_browser_set_up_function_(browser_)
  Actual: false
Expected: true
Stack trace:
Backtrace:
	testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop [0x00007FF7C99E69C7+87]
	testing::internal::AssertHelper::operator= [0x00007FF7C99E654E+78]
	InProcessBrowserTest::PreRunTestOnMainThread [0x00007FF7CC267A25+373]
	content::BrowserTestBase::ProxyRunTestOnMainThreadLoop [0x00007FF7CC2C754F+255]
	ChromeBrowserMainParts::PreMainMessageLoopRunImpl [0x00007FF7CD1432C3+4819]
	ChromeBrowserMainParts::PreMainMessageLoopRun [0x00007FF7CD141EE9+185]
	content::BrowserMainLoop::PreMainMessageLoopRun [0x00007FF7CA7FC9E5+85]
	content::StartupTaskRunner::RunAllTasksNow [0x00007FF7CAC12DE5+37]
	content::BrowserMainLoop::CreateStartupTasks [0x00007FF7CA7FB2A3+803]
	content::BrowserMainRunnerImpl::Initialize [0x00007FF7CA7FF43E+126]
	content::BrowserMain [0x00007FF7CA7F8E60+176]
	content::RunBrowserProcessMain [0x00007FF7CC24192F+111]
	content::ContentMainRunnerImpl::Run [0x00007FF7CC2422BD+637]
	service_manager::Main [0x00007FF7CC9AD610+2000]
	content::ContentMain [0x00007FF7CC241861+65]
	content::BrowserTestBase::SetUp [0x00007FF7CC2C72B3+2163]
	InProcessBrowserTest::SetUp [0x00007FF7CC266CF8+520]

>  they fail to ShowAndFocusNativeWindow() at the beginning of the test (before the test body)

That would explain quite a few similar failures, for example  issue 882159 ,  issue 882162 ,  issue 882095 ,  issue 882163 .

Renaming the bug's title to make it more accurate.

Reporting to stale-flakes-reports@google.com to investigate why this issue is not being processed despite being in an appropriate queue for 7 days or more.

 Issue 885076  has been merged into this issue.

 Issue 884994  has been merged into this issue.

 Issue 884995  has been merged into this issue.

 Issue 884996  has been merged into this issue.

 Issue 884997  has been merged into this issue.

Bumping this up due to multiple CQ flakes.

@jam: Any updates on this issue? Seems to be affecting quite a few tests.

Detected 4 new flakes for test/step "CrElementsCheckboxTest.All". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpDckVsZW1lbnRzQ2hlY2tib3hUZXN0LkFsbAw. This message was posted automatically by the chromium-try-flakes app.

Detected 4 new flakes for test/step "CrElementsInputTest.All". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyIgsSBUZsYWtlIhdDckVsZW1lbnRzSW5wdXRUZXN0LkFsbAw. This message was posted automatically by the chromium-try-flakes app.

Detected 4 new flakes for test/step "CrSettingsAnimatedPagesTest.All". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKgsSBUZsYWtlIh9DclNldHRpbmdzQW5pbWF0ZWRQYWdlc1Rlc3QuQWxsDA. This message was posted automatically by the chromium-try-flakes app.

Detected 4 new flakes for test/step "CrSettingsSyncPageTest.All". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpDclNldHRpbmdzU3luY1BhZ2VUZXN0LkFsbAw. This message was posted automatically by the chromium-try-flakes app.

 Issue 887717  has been merged into this issue.

 Issue 887718  has been merged into this issue.

 Issue 887723  has been merged into this issue.

 Issue 887719  has been merged into this issue.

 Issue 887724  has been merged into this issue.

The newly flaking tests span multiple WebUIs, not just Settings. Updating component.

Detected 3 new flakes for test/step "SettingsUIBrowserTest.All". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJAsSBUZsYWtlIhlTZXR0aW5nc1VJQnJvd3NlclRlc3QuQWxsDA. This message was posted automatically by the chromium-try-flakes app.

Detected 3 new flakes for test/step "CrSettingsFocusRowBehavior.FocusTest". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyLwsSBUZsYWtlIiRDclNldHRpbmdzRm9jdXNSb3dCZWhhdmlvci5Gb2N1c1Rlc3QM. This message was posted automatically by the chromium-try-flakes app.

Detected 3 new flakes for test/step "CrSettingsSyncPageTest.All". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpDclNldHRpbmdzU3luY1BhZ2VUZXN0LkFsbAw. This message was posted automatically by the chromium-try-flakes app.

Detected 3 new flakes for test/step "CrSettingsAnimatedPagesTest.All". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKgsSBUZsYWtlIh9DclNldHRpbmdzQW5pbWF0ZWRQYWdlc1Rlc3QuQWxsDA. This message was posted automatically by the chromium-try-flakes app.

CrElementsToggleTest.All is flaky.

Findit has detected 4 new flake occurrences of this test. List
of all flake occurrences can be found at:
https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyQQsSBUZsYWtlIjZjaHJvbWl1bUBpbnRlcmFjdGl2ZV91aV90ZXN0c0BDckVsZW1lbnRzVG9nZ2xlVGVzdC5BbGwM.

Since this test is still flaky, this issue has been moved back onto the Sheriff
Bug Queue if it's not already there.

This flaky test was previously tracked in  bug 887719 .

If the result above is wrong, please file a bug using this link:
https://bugs.chromium.org/p/chromium/issues/entry?status=Unconfirmed&labels=Pri-1,Test-Findit-Wrong&components=Tools%3ETest%3EFindit%3EFlakiness&summary=%5BFindit%5D%20Flake%20Detection%20-%20Wrong%20result%20for%20CrElementsToggleTest.All&comment=Link%20to%20flake%20occurrences%3A%20https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyQQsSBUZsYWtlIjZjaHJvbWl1bUBpbnRlcmFjdGl2ZV91aV90ZXN0c0BDckVsZW1lbnRzVG9nZ2xlVGVzdC5BbGwM

Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).

CrElementsCheckboxTest.All is flaky.

Findit has detected 4 new flake occurrences of this test. List
of all flake occurrences can be found at:
https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyQwsSBUZsYWtlIjhjaHJvbWl1bUBpbnRlcmFjdGl2ZV91aV90ZXN0c0BDckVsZW1lbnRzQ2hlY2tib3hUZXN0LkFsbAw.

Since this test is still flaky, this issue has been moved back onto the Sheriff
Bug Queue if it's not already there.

This flaky test was previously tracked in  bug 887717 .

If the result above is wrong, please file a bug using this link:
https://bugs.chromium.org/p/chromium/issues/entry?status=Unconfirmed&labels=Pri-1,Test-Findit-Wrong&components=Tools%3ETest%3EFindit%3EFlakiness&summary=%5BFindit%5D%20Flake%20Detection%20-%20Wrong%20result%20for%20CrElementsCheckboxTest.All&comment=Link%20to%20flake%20occurrences%3A%20https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyQwsSBUZsYWtlIjhjaHJvbWl1bUBpbnRlcmFjdGl2ZV91aV90ZXN0c0BDckVsZW1lbnRzQ2hlY2tib3hUZXN0LkFsbAw

Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).

CrElementsInputTest.All is flaky.

Findit has detected 4 new flake occurrences of this test. List
of all flake occurrences can be found at:
https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyQAsSBUZsYWtlIjVjaHJvbWl1bUBpbnRlcmFjdGl2ZV91aV90ZXN0c0BDckVsZW1lbnRzSW5wdXRUZXN0LkFsbAw.

Since this test is still flaky, this issue has been moved back onto the Sheriff
Bug Queue if it's not already there.

This flaky test was previously tracked in  bug 887718 .

If the result above is wrong, please file a bug using this link:
https://bugs.chromium.org/p/chromium/issues/entry?status=Unconfirmed&labels=Pri-1,Test-Findit-Wrong&components=Tools%3ETest%3EFindit%3EFlakiness&summary=%5BFindit%5D%20Flake%20Detection%20-%20Wrong%20result%20for%20CrElementsInputTest.All&comment=Link%20to%20flake%20occurrences%3A%20https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyQAsSBUZsYWtlIjVjaHJvbWl1bUBpbnRlcmFjdGl2ZV91aV90ZXN0c0BDckVsZW1lbnRzSW5wdXRUZXN0LkFsbAw

Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).

CrElementsProfileAvatarSelectorFocusTest.All is flaky.

Findit has detected 4 new flake occurrences of this test. List
of all flake occurrences can be found at:
https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyVQsSBUZsYWtlIkpjaHJvbWl1bUBpbnRlcmFjdGl2ZV91aV90ZXN0c0BDckVsZW1lbnRzUHJvZmlsZUF2YXRhclNlbGVjdG9yRm9jdXNUZXN0LkFsbAw.

Since this test is still flaky, this issue has been moved back onto the Sheriff
Bug Queue if it's not already there.

This flaky test was previously tracked in  bug 887723 .

If the result above is wrong, please file a bug using this link:
https://bugs.chromium.org/p/chromium/issues/entry?status=Unconfirmed&labels=Pri-1,Test-Findit-Wrong&components=Tools%3ETest%3EFindit%3EFlakiness&summary=%5BFindit%5D%20Flake%20Detection%20-%20Wrong%20result%20for%20CrElementsProfileAvatarSelectorFocusTest.All&comment=Link%20to%20flake%20occurrences%3A%20https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyVQsSBUZsYWtlIkpjaHJvbWl1bUBpbnRlcmFjdGl2ZV91aV90ZXN0c0BDckVsZW1lbnRzUHJvZmlsZUF2YXRhclNlbGVjdG9yRm9jdXNUZXN0LkFsbAw

Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).

CrSettingsSyncPageTest.All is flaky.

Findit has detected 4 new flake occurrences of this test. List
of all flake occurrences can be found at:
https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyQwsSBUZsYWtlIjhjaHJvbWl1bUBpbnRlcmFjdGl2ZV91aV90ZXN0c0BDclNldHRpbmdzU3luY1BhZ2VUZXN0LkFsbAw.

Since this test is still flaky, this issue has been moved back onto the Sheriff
Bug Queue if it's not already there.

This flaky test was previously tracked in  bug 887724 .

If the result above is wrong, please file a bug using this link:
https://bugs.chromium.org/p/chromium/issues/entry?status=Unconfirmed&labels=Pri-1,Test-Findit-Wrong&components=Tools%3ETest%3EFindit%3EFlakiness&summary=%5BFindit%5D%20Flake%20Detection%20-%20Wrong%20result%20for%20CrSettingsSyncPageTest.All&comment=Link%20to%20flake%20occurrences%3A%20https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyQwsSBUZsYWtlIjhjaHJvbWl1bUBpbnRlcmFjdGl2ZV91aV90ZXN0c0BDclNldHRpbmdzU3luY1BhZ2VUZXN0LkFsbAw

Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).

 Issue 887721  has been merged into this issue.

 Issue 887194  has been merged into this issue.

 Issue 882159  has been merged into this issue.

 Issue 887193  has been merged into this issue.

 Issue 887781  has been merged into this issue.

 Issue 882163  has been merged into this issue.

 Issue 882162  has been merged into this issue.

 Issue 882095  has been merged into this issue.

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/e10714dcb696f546b380105093a4f2a27a084520

commit e10714dcb696f546b380105093a4f2a27a084520
Author: Evan Stade <estade@chromium.org>
Date: Wed Sep 26 17:54:33 2018

Disable SettingsUIBrowserTest.All on Windows due to flakiness.

TBR=dpapad@chromium.org

Bug:  887721 ,711256
Change-Id: I57a9bac7415bf0a3439c6b85e8f1228ceca7d41b
Reviewed-on: https://chromium-review.googlesource.com/1246142
Reviewed-by: Evan Stade <estade@chromium.org>
Reviewed-by: Demetrios Papadopoulos <dpapad@chromium.org>
Commit-Queue: Evan Stade <estade@chromium.org>
Cr-Commit-Position: refs/heads/master@{#594379}
[modify] https://crrev.com/e10714dcb696f546b380105093a4f2a27a084520/chrome/test/data/webui/settings/settings_ui_browsertest.js

 Issue 812947  has been merged into this issue.

Another possible dupe in  issue 900392 , where tons of tests failed on global_browser_set_up_function_.

 Issue 900392  has been merged into this issue.