Issue metadata
Sign in to add a comment
|
runAccessibilityAudit is flaky |
||||||||||||||||||||||
Issue description"OptionsWebUITest.EnableAndDisableDoNotTrack" is flaky. This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label. We have detected 3 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyNgsSBUZsYWtlIitPcHRpb25zV2ViVUlUZXN0LkVuYWJsZUFuZERpc2FibGVEb05vdFRyYWNrDA. Flaky tests should be disabled within 30 minutes unless culprit CL is found and reverted. Please see more details here: https://sites.google.com/a/chromium.org/dev/developers/tree-sheriffs/sheriffing-bug-queues#triaging-auto-filed-flakiness-bugs
,
Apr 26 2016
This is affecting many WebUI tests (gathered from a few of the recent flakes): AdvancedSettingsWebUITest.testAdvancedSettingsShown AutofillOptionsWebUITest.testOpenAutofillOptions BrowserOptionsFrameWebUITest.testAdvancedSettingsHiddenByDefault EditDictionaryWebUITest.testAddNotification (x2) EditDictionaryWebUITest.testNoCloseOnSearchEnter FontSettingsWebUITest.testAdvancedFontSettingsLink FontSettingsWebUITest.testOpenFontSettings (x2) LanguageOptionsWebUITest.testOpenLanguageOptions (x2) LanguagesOptionsDictionaryDownloadWebUITest.testdictionaryDownloadRetry OptionsWebUITest.EnableAndDisableDoNotTrack (x3) OptionsWebUITest.EnableDoNotTrackAndConfirmInterstitial SettingsFormatWebUITest.RadioButtonNameValueCheck (x2) SettingsFormatWebUITest.RadioCheckboxStyleCheck (x2) All of them are the same, which is accessibility check is failing. Here is a typical output: *** Begin accessibility audit results *** An accessibility audit found Errors: Error: AX_ARIA_08 (Elements with ARIA roles must ensure required owned elements are present) failed on the following elements (1 - 2 of 2): #default-search-engine-list #other-search-engine-list See https://github.com/GoogleChrome/accessibility-developer-tools/wiki/Audit-Rules#ax_aria_08 for more information. *** End accessibility audit results *** at Object.runAccessibilityAudit (test_api.js:371:17) at Object.runAccessibilityAudit (test_api.js:501:22) at test_api.js:995:20 at testDone (test_api.js:783:31) at runTest (test_api.js:1042:7) at <anonymous>:1:1 gen/chrome/browser/ui/webui/options/settings_format_browsertest-gen.cc:53: Failure Value of: RunJavascriptTestF( false, "SettingsFormatWebUITest", "RadioButtonNameValueCheck") Actual: false Expected: true These tests are possibly broken but I think the accessibility audit code should not be flaky. Assigning to aboxhall to investigate. If necessary, we can re-assign onto the individual test owners but I think good to take a look at the accessibility audit system first.
,
Apr 26 2016
There's more failures in issue 605689 , which I'll dupe into this one.
,
Apr 26 2016
,
Apr 26 2016
aboxhall@: can we disable the crazy .focus() storm during tearDown() to see if this reduces flakiness?
,
Apr 26 2016
These are still frequently failing on the tree, so please fix or disable soon if possible. Thanks! https://build.chromium.org/p/chromium.win/builders/Win7%20Tests%20%281%29/builds/51705 https://build.chromium.org/p/chromium.win/builders/Win7%20Tests%20%281%29/builds/51727 https://build.chromium.org/p/chromium.win/builders/Win7%20Tests%20%281%29/builds/51810 https://build.chromium.org/p/chromium.win/builders/Win7%20Tests%20%281%29/builds/51813
,
May 12 2016
Issue 611233 has been merged into this issue.
,
May 12 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/b04fffc834429a96ddc89a32113b429aa52025b0 commit b04fffc834429a96ddc89a32113b429aa52025b0 Author: tapted <tapted@chromium.org> Date: Thu May 12 04:27:10 2016 Disable failing accessibility audit in OptionsWebUITest tests. Causes OptionsWebUITest.testDefaultZoomFactor to flake. TBR=dbeam@chromium.org BUG= 611233 , 606657 Review-Url: https://codereview.chromium.org/1973823002 Cr-Commit-Position: refs/heads/master@{#393181} [modify] https://crrev.com/b04fffc834429a96ddc89a32113b429aa52025b0/chrome/browser/ui/webui/options/options_browsertest.js
,
Mar 27 2017
,
Apr 21 2017
,
Apr 21 2017
,
Jun 7 2017
,
Dec 14 2017
,
Dec 14 2017
Some more info on the a11y testing framework we built over the summer. Been working on getting better documentation for it going forward. Feel free to ping me for more details where the doc is lacking :-) https://www.chromium.org/developers/accessibility/testing/axe-core |
|||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||
Comment 1 by mgiuca@chromium.org
, Apr 26 2016