Issue 605082 link

Starred by 1 user

Issue metadata

Status:	WontFix
Owner:	----
Closed:	Dec 2017
Cc:	bcwh...@chromium.org cmumford@chromium.org msramek@chromium.org dpa...@chromium.org
Components:	Tests>Flaky UI>Accessibility UI>Browser>WebUI UI>Settings
EstimatedDays:	----
NextAction:	----
OS:	Windows
Pri:	2
Type:	Bug
a11y-secondary
Team-Accessibility

WebUI tests flaky on Windows bots

Project Member Reported by msramek@chromium.org, Apr 20 2016

Issue description

Various individual tests from OptionsWebUITest and OptionsWebUIExtendedTest are flaky, each of them with a low frequency, but together, OptionsWebUIExtendedTest.* are seen quite often.

Examples from today:
OptionsWebUIExtendedTest.SupervisingUsers:
https://build.chromium.org/p/chromium.win/builders/Win%20x64%20GN/builds/12550/steps/browser_tests%20on%20Windows-7-SP1/logs/OptionsWebUIExtendedTest.SupervisingUsers

OptionsWebUIExtendedTest.OverlayBackToUnrelated:
https://build.chromium.org/p/chromium.win/builders/Win%20x64%20GN/builds/12554/steps/browser_tests%20on%20Windows-7-SP1/logs/OptionsWebUIExtendedTest.OverlayBackToUnrelated

OptionsWebUITest.EnableDoNotTrackAndConfirmInterstitial:
EnableDoNotTrackAndConfirmInterstitial:
https://build.chromium.org/p/chromium.win/builders/Win7%20Tests%20%281%29/builds/51512/steps/browser_tests%20on%20Windows-7-SP1/logs/OptionsWebUITest.EnableDoNotTrackAndConfirmInterstitial

LanguagesOptionsDictionaryDownloadWebUITest.testdictionaryDownloadRetry:
https://build.chromium.org/p/chromium.win/builders/Win7%20Tests%20%281%29/builds/51512/steps/browser_tests%20on%20Windows-7-SP1/logs/LanguagesOptionsDictionaryDownloadWebUITest.testdictionaryDownloadRetry

ContentSettingsExceptionAreaWebUITest.testOpenContentSettingsExceptionArea:
https://build.chromium.org/p/chromium.win/builders/Win7%20Tests%20%28dbg%29%281%29/builds/47940/steps/browser_tests%20on%20Windows-7-SP1/logs/ContentSettingsExceptionAreaWebUITest.testOpenContentSettingsExceptionArea

Comment 1 by msramek@chromium.org, Apr 20 2016

Components: UI>Accessibility

Of the five reported, the first four fail on the same accessibility issue: https://github.com/GoogleChrome/accessibility-developer-tools/wiki/Audit-Rules#ax_aria_08

The fifth one is unrelated (probably timeout).

ax_aria_08 says "Elements with ARIA roles must ensure required owned elements are present". The flakiness is probably caused by those owned elements not always being created.

Not sure if this is still worth investigating, as WebUI is deprecated. We might disable the tests or just suppress that accessibility rule for the time being.

Comment 2 by msramek@chromium.org, Apr 20 2016

Components: UI>Settings UI>Browser>WebUI

Comment 3 by msramek@chromium.org, Apr 20 2016

Status: Available (was: Started)

Two more recent data points, the same accessibility issue:

ContentOptionsWebUITest.testOpenContentOptions:
https://build.chromium.org/p/chromium.win/builders/Win%207%20Tests%20x64%20%281%29/builds/13026/steps/browser_tests%20on%20Windows-7-SP1/logs/ContentOptionsWebUITest.testOpenContentOptions

OptionsWebUITest.EnableDoNotTrackAndCancelInterstitial:
https://build.chromium.org/p/chromium.win/builders/Win%207%20Tests%20x64%20%281%29/builds/13026/steps/browser_tests%20on%20Windows-7-SP1/logs/OptionsWebUITest.EnableDoNotTrackAndCancelInterstitial

Comment 4 by dmazz...@chromium.org, Mar 7 2017

Labels: NewComponent-Accessibility-Browser

Comment 5 by dmazz...@chromium.org, Mar 27 2017

Labels: NewComponent-Accessibility

Comment 6 by dmazz...@chromium.org, Apr 21 2017

Labels: -newcomponent-accessibility-browser -newcomponent-accessibility

Comment 7 by dmazz...@chromium.org, Aug 4 2017

Labels: triage-dominic

Comment 8 by leberly@chromium.org, Dec 14 2017

Labels: -triage-dominic a11y-secondary

Comment 9 by dpa...@chromium.org, Dec 15 2017

Status: WontFix (was: Available)

All of the above mentioned tests have been deleted. Closing this issue.

►

Issue 605082 link

Issue metadata

WebUI tests flaky on Windows bots

Issue description

Comment 1 by msramek@chromium.org, Apr 20 2016

Comment 1 Deleted

Comment 2 by msramek@chromium.org, Apr 20 2016

Comment 2 Deleted

Comment 3 by msramek@chromium.org, Apr 20 2016

Comment 3 Deleted

Comment 4 by dmazz...@chromium.org, Mar 7 2017

Comment 4 Deleted

Comment 5 by dmazz...@chromium.org, Mar 27 2017

Comment 5 Deleted

Comment 6 by dmazz...@chromium.org, Apr 21 2017

Comment 6 Deleted

Comment 7 by dmazz...@chromium.org, Aug 4 2017

Comment 7 Deleted

Comment 8 by leberly@chromium.org, Dec 14 2017

Comment 8 Deleted

Comment 9 by dpa...@chromium.org, Dec 15 2017

Comment 9 Deleted

Sign in to add a comment