Issue metadata
Sign in to add a comment
|
Word boundary callback doesn't work with "US English Female Text to Speech (by Google)"
Reported by
0x435...@gmail.com,
Aug 17 2017
|
||||||||||||||||||||||||
Issue descriptionUserAgent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.90 Safari/537.36 Steps to reproduce the problem: 1. Download and install extension "US English Female Text to Speech (by Google)" from https://chrome.google.com/webstore/detail/us-english-female-text-to/pkidpnnapnfgjhfhkpmjpbckkbaodldb 2. Open a book in Bookshare Web Reader. You can see an example by going to this page and choosing "Read Now" https://www.bookshare.org/browse/book/4905 Web Reader is a Javascript-based reader that is based on an old fork of the Readium project. 3. Wait for a minute for the book to be processed 4. When the book comes up, click "No Thanks" if it asks you to try BeeLine. 5. Open the settings (gear icon) 6. Select "US English Female TTS (by Google)" from the voice dropdown and save your settings. 7. Click the Play button. (It's in the toolbar in the upper left, and looks like a speech bubble with a speaker icon on it.) What is the expected behavior? The reader should highlight each sentence and each word as it is read. You can see this behavior by selecting the voice "Microsoft David Desktop" in the settings and clicking the Play button. What went wrong? The reader does not perform any highlighting as it is read. Did this work before? No Does this work in other browsers? No The behavior uses aspects of the SpeechSynthesis API that are not yet implemented consistently in other browsers, and we are only supporting them in Chrome in our application. If you choose a built-in Windows voice with Chrome, like "Microsoft David Desktop" the word boundaries and highlighting work as expected. Chrome version: 60.0.3112.101 (Official Build) (64-bit) (cohort: Stable) Channel: stable OS Version: Windows 10 Enterprise Edition 1511 OS Build 10586.633 Flash Version: 24.0.0.189 internal-not-yet-present The bug is the same as Issue 648215 for builtin voices. If you look at the code for web reader, you can see the setup of the voice callback in ttsPlayer.js around line 47. It calls _createCallbackHandler. Later, you can use the debugger to see that no onboundary events are sent to the callback handler when the "US English Female TTS (by Google)" is selected. As with the related issue 648215 , we need the boundary events to perform highlighting to help our users who have difficulty reading. We have gotten feedback that users prefer Google's higher quality voice to the builtin voices that come with the operating system.
,
Aug 22 2017
It looks like you were able to reproduce the desired behavior but not the issue. You won't be able to see the issue unless you can see the "US English Female TTS (by Google)" item appears in the Voice dropdown in the Web Reader Settings menu. Attaching a .webm file illustrating both the expected behavior and the issue. Does "US English Female Text-to-speech (by Google)" show up in the list of Chrome extensions? Another difference may be that I am running Windows 10. I cannot determine your Windows version. However, I would be surprised if the behavior were different on different versions of Windows. I do not have access to a Mac and cannot repeat the test there. I was able to reproduce the installed extension and issue on Ubuntu 16, and have included a screencast of that here.
,
Aug 22 2017
Thank you for providing more feedback. Adding requester "susanjuniab@chromium.org" to the cc list and removing "Needs-Feedback" label. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
Aug 22 2017
I'm attaching another file that shows with the Developer Tools debugger that the execution does not seem to step into the code activated by boundary events. In the original issue description I referred to the file in question as ttsPlayer.js, but in the publicly published version of the application, the file is packed as 89c7482ab9e755902b6de63f0c916d96.js (The name of the file will change with future deployments, but it will consistently be the randomly named file in the scripts folder.) The video is a bit confusing because the speech seems to run on its own thread, but you can see that the execution is "caught" in the debugger with the builtin voice and the objects can be inspected, but the execution is not caught with the "US English Female TTS (by Google)" voice.
,
Sep 1 2017
@reporter thanks for the feedback. Retried the issue on Windows-10 and Ubuntu 14.04 and unable to repro the issue by following the steps mentioned in comment #4. In both Windows-10 and Ubuntu 14.04, unable to find the value "US English Female Text-to-speech (by Google)" under the voice drop down after adding the extension to chrome. Requesting 'Accessibility' to look into the issue and help in further triaging. Thanks.
,
Sep 1 2017
// Correction in comment #5 Retried the issue on Windows-10, Ubuntu 14.04 using the latest Stable 60.0.3112.113 and Canary 62.0.3201.0 and unable to repro the issue by following the steps mentioned in comment #4. In both Windows-10 and Ubuntu 14.04, unable to find the value "US English Female Text-to-speech (by Google)" under the voice drop down after adding the extension to chrome. Requesting 'Accessibility' to look into the issue and help in further triaging. Thanks.
,
Oct 17 2017
Google Chrome 64.0.3242.0 (Official Build) canary (64-bit) (cohort: 64-Bit) Google Chrome 61.0.3163.100 (Official Build) (64-bit) (cohort: Stable) Windows 10 Enterprise Version 10.0.14393 Build 14393 Hello, Thanks for this detailed report. I, too, am unable to get the TTS voice to show up in Bookshare. I am therefore resolving this bug as WontFix because I can't reproduce it. Please reopen it if you have more information for me. Here are the steps I followed to attempt to reproduce: 1. Download and install extension "US English Female Text to Speech (by Google)" from https://chrome.google.com/webstore/detail/us-english-female-text-to/pkidpnnapnfgjhfhkpmjpbckkbaodldb - pass 2. Open a book in Bookshare Web Reader. You can see an example by going to this page and choosing "Read Now" https://www.bookshare.org/browse/book/4905 Web Reader is a Javascript-based reader that is based on an old fork of the Readium project. - pass, I signed in using my account 3. Wait for a minute for the book to be processed - pass 4. When the book comes up, click "No Thanks" if it asks you to try BeeLine. - pass 5. Open the settings (gear icon) - pass 6. Select "US English Female TTS (by Google)" from the voice dropdown and save your settings. - fail in Canary AND in stable. Voice does not appear in the dropdown. I tried uninstalling and reinstalling the extension and rebooting my machine. These are my only two options: Microsoft David Desktop - English (United States) (default) Microsoft Zira Desktop - English (United States) I tested the extension's functionality itself by opening Chrome OS on my Chromebook, enabling ChromeVox, and selecting this TTS voice in ChromeVox settings. That worked without issue. Please let me know if you are still seeing this behavior on your end and if so, how you are using that voice. Thanks, Laura
,
Feb 13 2018
In Comments 5, 6, and 7, when you refer to the voice dropdown, are you referring to the setting in the operating system or the setting in Web Reader? |
|||||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||||
Comment 1 by susanjuniab@chromium.org
, Aug 22 2017Components: Platform>Extensions
Labels: Needs-Triage-M60 Needs-Feedback
@reporter Thanks for the issue. Tested the issue on Windows 7 and Mac OS 10.12.6 with latest stable 60.0.3112.101 and Canary 62.0.3192.0 with the below steps. 1. Launched Chrome and added the "US English Female Text to Speech (by Google)" extension to Chrome. 2. Clicked on the above given link to open bookshare page and clicked on 'Read'. 3. Clicked on "No Thanks" when a prompt came up on screen asking to try BeeLine. 4. Clicked on the Play button and the reader is highlighting each sentence and each word as it is read. Note: Couldn't find the option "US English Female TTS (by Google)" in the dropdown menu under voice in Settings page. Option is not populated in the dropdow after relaunching the browser as well. Please find the attached screen shot from Windows and Mac showing the dropdown of voice settings. Also PFA the screen cast of the steps followed and confirm if anything is missed here. Thanks..352 KB
352 KB View Download
223 KB
223 KB View Download
10.4 MB
10.4 MB View Download