New issue
Advanced search Search tips

Issue 794728 link

Starred by 2 users

Issue metadata

Status: Fixed
Owner: ----
Closed: Jun 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 3
Type: Bug
STS
Team-Accessibility



Sign in to add a comment

[Select-to-Speak] Select to speak doesn't work on virtual keyboard

Project Member Reported by katie@chromium.org, Dec 13 2017

Issue description

Select-to-Speak isn't finding the virtual keyboard regions highlighted in the Hit test.
 

Comment 1 by katie@chromium.org, Dec 15 2017

Note: chrome://keyboard works great with select-to-speak, but the embedded keyboard does not!

It does seem like the virtual keyboard is in the a11y tree though:

>> desktop.findAll({attributes: {'name': 'caps lock'}})
This returns a static text and an inlineTextBox in the right location: {left: 204, top: 141, width: 73, height: 20}

However they are labeled as offscreen, and they are in a window marked as 'invisible'.

>> capsLockNodes[0].parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.state
{invisible: true}
>> capsLockNodes[0].parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.role
"window"
>> capsLockNodes[0].parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.parent.location
{left: 0, top: 488, width: 1366, height: 280}

The keyboard is in a position:fixed container, which might be a potential cause of the issue? Although the same is true in chrome://keyboard.

Comment 2 by katie@chromium.org, Dec 28 2017

Possibly relevant:

Seems like most Accessibility events are not getting fired when the keyboard pops up, only when it goes back down again.

For example, if you close the main chrome browser window (to avoid extra messages) and pull up the keyboard, there are no accessibility events logged by render_accessibility_impl.cc. But when you close the keyboard, lots of events are logged. 

Comment 3 by katie@chromium.org, Mar 19 2018

Components: UI>Accessibility>SelectToSpeak

Comment 4 by katie@chromium.org, Mar 19 2018

Components: -UI>Accessibility

Comment 5 by katie@chromium.org, Apr 7 2018

 Issue 830126  has been merged into this issue.

Comment 6 by katie@chromium.org, Jun 8 2018

Status: Fixed (was: Available)
Select to Speak works on the keyboard now. However, node bounds are incorrect (although they ARE correct in ChromeVox!?) That will be tracked separately.

Sign in to add a comment