New issue
Advanced search Search tips

Issue 761461 link

Starred by 1 user
Status: Started
Owner:
hcarmona@chromium.org
Cc:
dmazz...@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug
Team-Accessibility

Blocked on:
issue 748608


Sign in to add a comment

Flaky / intermittent failure in SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast

Project Member Reported by lukasza@chromium.org, Sep 1 2017 
There was a failure on https://uberchromegw.corp.google.com/i/chromium.win/builders/Win%207%20Tests%20x64%20%281%29/builds/28323:

https://luci-logdog.appspot.com/v/?s=chromium%2Fbb%2Fchromium.win%2FWin_7_Tests_x64__1_%2F28323%2F%2B%2Frecipes%2Fsteps%2Fbrowser_tests%2F0%2Flogs%2FSettingsAccessibilityTest.MANAGE_PROFILE_color_contrast%2F0:

[5800:6052:0901/103201.228:ERROR:CONSOLE(48)] "Mocha test failed: MANAGE_PROFILE_color_contrast Accessible with No Changes
Error: the string "Found 1 accessibility violations." was thrown, throw an Error :)
    at <anonymous>
", source: mocha_adapter.js (48)


There were no other failures, so either the test is flaky or the failure was fixed?

Comment 1 by lukasza@chromium.org, Sep 1 2017

Summary: Flaky / intermittent failure in SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast (was: Flaky/intermittrent failure in SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast)

Comment 2 by dmazz...@chromium.org, Sep 5 2017

Cc: -quacht@google.com
Owner: hcarmona@chromium.org
Status: Assigned (was: Untriaged)

Comment 3 by kbr@chromium.org, Sep 5 2017

Labels: -Pri-2 Pri-1
This is affecting jobs on the commit queue:

https://luci-milo.appspot.com/buildbot/tryserver.chromium.win/win_chromium_rel_ng/526666
https://luci-milo.appspot.com/buildbot/tryserver.chromium.win/win_chromium_rel_ng/526631

Raising to P1 since this is affecting the commit queue. Log follows from one of the failures.

LogDog : chromium/bb/tryserver.chromium.win/win_chromium_rel_ng/526666/+/recipes/steps/browser_tests__with_patch_/0/logs/SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast/0  kbr@chromium.org | Sign out
 [ RUN      ] SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast
[3080:4264:0905/154532.897:ERROR:direct_composition_surface_win.cc(1095)] Failing to detect HDR, couldn't retrieve D3D11 device from ANGLE.
[3080:4264:0905/154532.907:INFO:media_foundation_video_encode_accelerator_win.cc(335)] Windows versions earlier than 8 are not supported.
[5216:4908:0905/154535.499:INFO:CONSOLE(1220)] "Running TestCase SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast", source: test_api.js (1220)
[5216:4908:0905/154539.271:INFO:CONSOLE(196)] "[
    {
        "id": "color-contrast",
        "impact": "serious",
        "tags": [
            "cat.color",
            "wcag2aa",
            "wcag143"
        ],
        "description": "Ensures the contrast between foreground and background colors meets WCAG 2 AA contrast ratio thresholds",
        "help": "Elements must have sufficient color contrast",
        "helpUrl": "https://dequeuniversity.com/rules/axe/3.0/color-contrast?application=axeAPI",
        "nodes": [
            {
                "any": [
                    {
                        "id": "color-contrast",
                        "data": {
                            "fgColor": "#fbfbfb",
                            "bgColor": "#f1f1f1",
                            "contrastRatio": 1.08,
                            "fontSize": "9.8pt",
                            "fontWeight": "normal"
                        },
                        "relatedNodes": [
                            {
                                "html": "<html dir=\"ltr\" lang=\"en\" class=\"\">",
                                "target": [
                                    "html"
                                ]
                            }
                        ],
                        "impact": "serious",
                        "message": "Element has insufficient color contrast of 1.08 (foreground color: #fbfbfb, background color: #f1f1f1, font size: 9.8pt, font weight: normal)"
                    }
                ],
                "all": [],
                "none": [],
                "impact": "serious",
                "html": "<label id=\"prompt\" for=\"searchInput\" aria-hidden=\"true\">Search settings</label>",
                "target": [
                    [
                        "body > settings-ui",
                        "cr-toolbar[role=\"none\"]",
                        "#search",
                        "#prompt"
                    ]
                ],
                "failureSummary": "Fix any of the following:\n  Element has insufficient color contrast of 1.08 (foreground color: #fbfbfb, background color: #f1f1f1, font size: 9.8pt, font weight: normal)"
            }
        ]
    }
]", source: accessibility_test.js (196)
[5216:4908:0905/154539.274:ERROR:CONSOLE(48)] "Mocha test failed: MANAGE_PROFILE_color_contrast Accessible with No Changes
Error: the string "Found 1 accessibility violations." was thrown, throw an Error :)
    at <anonymous>
", source: mocha_adapter.js (48)
[5216:4908:0905/154539.307:ERROR:web_ui_test_handler.cc(82)] Test Errors: 1/1 tests had failed assertions.
[5216:4908:0905/154539.307:ERROR:web_ui_browser_test.cc(467)] CONDITION FAILURE: encountered javascript console error(s):
[5216:4908:0905/154539.307:ERROR:web_ui_browser_test.cc(469)] JS ERROR: '[5216:4908:0905/154539.274:ERROR:CONSOLE(48)] "Mocha test failed: MANAGE_PROFILE_color_contrast Accessible with No Changes
Error: the string "Found 1 accessibility violations." was thrown, throw an Error :)
    at <anonymous>
", source: mocha_adapter.js (48)
'
[5216:4908:0905/154539.307:ERROR:web_ui_browser_test.cc(471)] JS call assumed failed, because JS console error(s) found.
gen/chrome/test/data/webui/settings/a11y/manage_profile_a11y_test-gen.cc(602): error: Value of: RunJavascriptTestF( true, "SettingsAccessibilityTest", "MANAGE_PROFILE_color_contrast")
  Actual: false
Expected: true
[5216:4908:0905/154539.339:INFO:chrome_cryptauth_service.cc(222)] Profile is not authenticated yet; waiting before starting CryptAuth managers.
[5216:4908:0905/154539.340:ERROR:event_page_request_manager.cc(154)] An error encountered while waking the event page.
[5216:4908:0905/154539.340:ERROR:event_page_request_manager.cc(96)] Draining request queue. (queue-length=3)
[  FAILED  ] SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast, where TypeParam =  and GetParam() =  (6795 ms)
[ RUN      ] SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast
[5032:3572:0905/154739.126:ERROR:direct_composition_surface_win.cc(1095)] Failing to detect HDR, couldn't retrieve D3D11 device from ANGLE.
[5032:3572:0905/154739.136:INFO:media_foundation_video_encode_accelerator_win.cc(335)] Windows versions earlier than 8 are not supported.
[2884:4072:0905/154740.192:ERROR:process_win.cc(139)] Unable to terminate process: Access is denied. (0x5)
[2884:3688:0905/154742.414:INFO:CONSOLE(1220)] "Running TestCase SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast", source: test_api.js (1220)
[2884:3688:0905/154745.658:INFO:CONSOLE(196)] "[
    {
        "id": "color-contrast",
        "impact": "serious",
        "tags": [
            "cat.color",
            "wcag2aa",
            "wcag143"
        ],
        "description": "Ensures the contrast between foreground and background colors meets WCAG 2 AA contrast ratio thresholds",
        "help": "Elements must have sufficient color contrast",
        "helpUrl": "https://dequeuniversity.com/rules/axe/3.0/color-contrast?application=axeAPI",
        "nodes": [
            {
                "any": [
                    {
                        "id": "color-contrast",
                        "data": {
                            "fgColor": "#fbfbfb",
                            "bgColor": "#f1f1f1",
                            "contrastRatio": 1.08,
                            "fontSize": "9.8pt",
                            "fontWeight": "normal"
                        },
                        "relatedNodes": [
                            {
                                "html": "<html dir=\"ltr\" lang=\"en\" class=\"\">",
                                "target": [
                                    "html"
                                ]
                            }
                        ],
                        "impact": "serious",
                        "message": "Element has insufficient color contrast of 1.08 (foreground color: #fbfbfb, background color: #f1f1f1, font size: 9.8pt, font weight: normal)"
                    }
                ],
                "all": [],
                "none": [],
                "impact": "serious",
                "html": "<label id=\"prompt\" for=\"searchInput\" aria-hidden=\"true\">Search settings</label>",
                "target": [
                    [
                        "body > settings-ui",
                        "cr-toolbar[role=\"none\"]",
                        "#search",
                        "#prompt"
                    ]
                ],
                "failureSummary": "Fix any of the following:\n  Element has insufficient color contrast of 1.08 (foreground color: #fbfbfb, background color: #f1f1f1, font size: 9.8pt, font weight: normal)"
            }
        ]
    }
]", source: accessibility_test.js (196)
[2884:3688:0905/154745.662:ERROR:CONSOLE(48)] "Mocha test failed: MANAGE_PROFILE_color_contrast Accessible with No Changes
Error: the string "Found 1 accessibility violations." was thrown, throw an Error :)
    at <anonymous>
", source: mocha_adapter.js (48)
[2884:3688:0905/154745.698:ERROR:web_ui_test_handler.cc(82)] Test Errors: 1/1 tests had failed assertions.
[2884:3688:0905/154745.698:ERROR:web_ui_browser_test.cc(467)] CONDITION FAILURE: encountered javascript console error(s):
[2884:3688:0905/154745.698:ERROR:web_ui_browser_test.cc(469)] JS ERROR: '[2884:3688:0905/154745.662:ERROR:CONSOLE(48)] "Mocha test failed: MANAGE_PROFILE_color_contrast Accessible with No Changes
Error: the string "Found 1 accessibility violations." was thrown, throw an Error :)
    at <anonymous>
", source: mocha_adapter.js (48)
'
[2884:3688:0905/154745.698:ERROR:web_ui_browser_test.cc(471)] JS call assumed failed, because JS console error(s) found.
gen/chrome/test/data/webui/settings/a11y/manage_profile_a11y_test-gen.cc(602): error: Value of: RunJavascriptTestF( true, "SettingsAccessibilityTest", "MANAGE_PROFILE_color_contrast")
  Actual: false
Expected: true
[2884:3688:0905/154745.739:INFO:chrome_cryptauth_service.cc(222)] Profile is not authenticated yet; waiting before starting CryptAuth managers.
[2884:3688:0905/154745.741:ERROR:event_page_request_manager.cc(154)] An error encountered while waking the event page.
[2884:3688:0905/154745.741:ERROR:event_page_request_manager.cc(96)] Draining request queue. (queue-length=3)
[  FAILED  ] SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast, where TypeParam =  and GetParam() =  (6929 ms)
[ RUN      ] SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast
[4868:1084:0905/154746.355:ERROR:direct_composition_surface_win.cc(1095)] Failing to detect HDR, couldn't retrieve D3D11 device from ANGLE.
[4868:1084:0905/154746.364:INFO:media_foundation_video_encode_accelerator_win.cc(335)] Windows versions earlier than 8 are not supported.
[3960:2436:0905/154747.432:ERROR:process_win.cc(139)] Unable to terminate process: Access is denied. (0x5)
[3960:4528:0905/154748.558:INFO:CONSOLE(1220)] "Running TestCase SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast", source: test_api.js (1220)
[3960:4528:0905/154752.575:INFO:CONSOLE(196)] "[
    {
        "id": "color-contrast",
        "impact": "serious",
        "tags": [
            "cat.color",
            "wcag2aa",
            "wcag143"
        ],
        "description": "Ensures the contrast between foreground and background colors meets WCAG 2 AA contrast ratio thresholds",
        "help": "Elements must have sufficient color contrast",
        "helpUrl": "https://dequeuniversity.com/rules/axe/3.0/color-contrast?application=axeAPI",
        "nodes": [
            {
                "any": [
                    {
                        "id": "color-contrast",
                        "data": {
                            "fgColor": "#fbfbfb",
                            "bgColor": "#f1f1f1",
                            "contrastRatio": 1.08,
                            "fontSize": "9.8pt",
                            "fontWeight": "normal"
                        },
                        "relatedNodes": [
                            {
                                "html": "<html dir=\"ltr\" lang=\"en\" class=\"\">",
                                "target": [
                                    "html"
                                ]
                            }
                        ],
                        "impact": "serious",
                        "message": "Element has insufficient color contrast of 1.08 (foreground color: #fbfbfb, background color: #f1f1f1, font size: 9.8pt, font weight: normal)"
                    }
                ],
                "all": [],
                "none": [],
                "impact": "serious",
                "html": "<label id=\"prompt\" for=\"searchInput\" aria-hidden=\"true\">Search settings</label>",
                "target": [
                    [
                        "body > settings-ui",
                        "cr-toolbar[role=\"none\"]",
                        "#search",
                        "#prompt"
                    ]
                ],
                "failureSummary": "Fix any of the following:\n  Element has insufficient color contrast of 1.08 (foreground color: #fbfbfb, background color: #f1f1f1, font size: 9.8pt, font weight: normal)"
            }
        ]
    }
]", source: accessibility_test.js (196)
[3960:4528:0905/154752.577:ERROR:CONSOLE(48)] "Mocha test failed: MANAGE_PROFILE_color_contrast Accessible with No Changes
Error: the string "Found 1 accessibility violations." was thrown, throw an Error :)
    at <anonymous>
", source: mocha_adapter.js (48)
[3960:4528:0905/154752.609:ERROR:web_ui_test_handler.cc(82)] Test Errors: 1/1 tests had failed assertions.
[3960:4528:0905/154752.609:ERROR:web_ui_browser_test.cc(467)] CONDITION FAILURE: encountered javascript console error(s):
[3960:4528:0905/154752.609:ERROR:web_ui_browser_test.cc(469)] JS ERROR: '[3960:4528:0905/154752.577:ERROR:CONSOLE(48)] "Mocha test failed: MANAGE_PROFILE_color_contrast Accessible with No Changes
Error: the string "Found 1 accessibility violations." was thrown, throw an Error :)
    at <anonymous>
", source: mocha_adapter.js (48)
'
[3960:4528:0905/154752.609:ERROR:web_ui_browser_test.cc(471)] JS call assumed failed, because JS console error(s) found.
gen/chrome/test/data/webui/settings/a11y/manage_profile_a11y_test-gen.cc(602): error: Value of: RunJavascriptTestF( true, "SettingsAccessibilityTest", "MANAGE_PROFILE_color_contrast")
  Actual: false
Expected: true
[4868:1084:0905/154752.624:WARNING:ipc_message_attachment_set.cc(49)] MessageAttachmentSet destroyed with unconsumed attachments: 0/1
[3960:4528:0905/154752.643:INFO:chrome_cryptauth_service.cc(222)] Profile is not authenticated yet; waiting before starting CryptAuth managers.
[3960:4528:0905/154752.644:ERROR:event_page_request_manager.cc(154)] An error encountered while waking the event page.
[3960:4528:0905/154752.644:ERROR:event_page_request_manager.cc(96)] Draining request queue. (queue-length=3)
[  FAILED  ] SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast, where TypeParam =  and GetParam() =  (6665 ms)
[ RUN      ] SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast
[3892:5204:0905/154753.030:ERROR:direct_composition_surface_win.cc(1095)] Failing to detect HDR, couldn't retrieve D3D11 device from ANGLE.
[3892:5204:0905/154753.043:INFO:media_foundation_video_encode_accelerator_win.cc(335)] Windows versions earlier than 8 are not supported.
[5904:5144:0905/154753.718:ERROR:process_win.cc(139)] Unable to terminate process: Access is denied. (0x5)
[5904:4324:0905/154755.140:INFO:CONSOLE(1220)] "Running TestCase SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast", source: test_api.js (1220)
[5904:4324:0905/154759.427:INFO:CONSOLE(196)] "[
    {
        "id": "color-contrast",
        "impact": "serious",
        "tags": [
            "cat.color",
            "wcag2aa",
            "wcag143"
        ],
        "description": "Ensures the contrast between foreground and background colors meets WCAG 2 AA contrast ratio thresholds",
        "help": "Elements must have sufficient color contrast",
        "helpUrl": "https://dequeuniversity.com/rules/axe/3.0/color-contrast?application=axeAPI",
        "nodes": [
            {
                "any": [
                    {
                        "id": "color-contrast",
                        "data": {
                            "fgColor": "#fbfbfb",
                            "bgColor": "#f1f1f1",
                            "contrastRatio": 1.08,
                            "fontSize": "9.8pt",
                            "fontWeight": "normal"
                        },
                        "relatedNodes": [
                            {
                                "html": "<html dir=\"ltr\" lang=\"en\" class=\"\">",
                                "target": [
                                    "html"
                                ]
                            }
                        ],
                        "impact": "serious",
                        "message": "Element has insufficient color contrast of 1.08 (foreground color: #fbfbfb, background color: #f1f1f1, font size: 9.8pt, font weight: normal)"
                    }
                ],
                "all": [],
                "none": [],
                "impact": "serious",
                "html": "<label id=\"prompt\" for=\"searchInput\" aria-hidden=\"true\">Search settings</label>",
                "target": [
                    [
                        "body > settings-ui",
                        "cr-toolbar[role=\"none\"]",
                        "#search",
                        "#prompt"
                    ]
                ],
                "failureSummary": "Fix any of the following:\n  Element has insufficient color contrast of 1.08 (foreground color: #fbfbfb, background color: #f1f1f1, font size: 9.8pt, font weight: normal)"
            }
        ]
    }
]", source: accessibility_test.js (196)
[5904:4324:0905/154759.429:ERROR:CONSOLE(48)] "Mocha test failed: MANAGE_PROFILE_color_contrast Accessible with No Changes
Error: the string "Found 1 accessibility violations." was thrown, throw an Error :)
    at <anonymous>
", source: mocha_adapter.js (48)
[5904:4324:0905/154759.509:ERROR:web_ui_test_handler.cc(82)] Test Errors: 1/1 tests had failed assertions.
[5904:4324:0905/154759.509:ERROR:web_ui_browser_test.cc(467)] CONDITION FAILURE: encountered javascript console error(s):
[5904:4324:0905/154759.509:ERROR:web_ui_browser_test.cc(469)] JS ERROR: '[5904:4324:0905/154759.429:ERROR:CONSOLE(48)] "Mocha test failed: MANAGE_PROFILE_color_contrast Accessible with No Changes
Error: the string "Found 1 accessibility violations." was thrown, throw an Error :)
    at <anonymous>
", source: mocha_adapter.js (48)
'
[5904:4324:0905/154759.509:ERROR:web_ui_browser_test.cc(471)] JS call assumed failed, because JS console error(s) found.
gen/chrome/test/data/webui/settings/a11y/manage_profile_a11y_test-gen.cc(602): error: Value of: RunJavascriptTestF( true, "SettingsAccessibilityTest", "MANAGE_PROFILE_color_contrast")
  Actual: false
Expected: true
[5904:4324:0905/154759.551:INFO:chrome_cryptauth_service.cc(222)] Profile is not authenticated yet; waiting before starting CryptAuth managers.
[5904:4324:0905/154759.553:ERROR:event_page_request_manager.cc(154)] An error encountered while waking the event page.
[5904:4324:0905/154759.553:ERROR:event_page_request_manager.cc(96)] Draining request queue. (queue-length=3)
[  FAILED  ] SettingsAccessibilityTest.MANAGE_PROFILE_color_contrast, where TypeParam =  and GetParam() =  (6769 ms)

Comment 4 by hcarmona@chromium.org, Sep 13 2017

Status: Started (was: Assigned)
Disabling test, will investigate further after that

Comment 5 by hcarmona@chromium.org, Sep 13 2017

Blockedon: 748608
►

Sign in to add a comment