New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 618691 link

Starred by 5 users

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

New Tab interupts audio playback with Hotword detection enabled

Reported by razgriz....@gmail.com, Jun 9 2016

Issue description

UserAgent: Mozilla/5.0 (X11; CrOS x86_64 8172.47.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.79 Safari/537.36
Platform: 8172.47.0 (Official Build) stable-channel cyan

Example URL:

Steps to reproduce the problem:
1. Enable OK Google Hotword detection
2. Play music in Google Play Music
3. Open a new tab

What is the expected behavior?
Opening a new tab does not interrupt music playback, but 'OK Google' detection does to allow clear speech recognition

What went wrong?
Upon opening a new tab, audio playback stutters for a short time as the listening service kicks in. 

Did this work before? Yes As far as I am aware, this works fine on the Acer 720 and CB3-131 fine. 

Is it a problem with Flash or HTML5? N/A

Does this work in other browsers? N/A 

Chrome version: 51.0.2704.79  Channel: stable
OS Version: 8172.47.0
Flash Version: Shockwave Flash 21.0 r0

Quite an annoying issue, as I have to disable the hotword detection to prevent all new tabs opened from interrupting music playback. Occurs if tabs are opened from clicking links too.
 
Further to this, I have video proof of the issue: https://www.youtube.com/watch?v=5LKW-OHNd10
Cc: dgreid@chromium.org avkodipelli@chromium.org
Components: -Internals>Media OS>Kernel>Audio
Labels: -Pri-2 Pri-1
razgriz.wilson6@ thanks for reporting the problem. Could you confirm if this is a regression from the previous release on your Chromebook? Thanks!

Also, could you file a feeback report (ctrl + shift + i)? Please add this bug number so we can find it. Thanks!

Avinash, can we confirm this issue on a BSWL device?
I can confirm that this was present on previous versions of ChromeOS. I have submitted the feedback report as you have requested, and included some more information. I have since used a USB sound card and noticed that with both the mic and aux connected, and hot word detection enabled, the issue did not re-occur. This may be because the USB sound card is processing the audio though so remains an internal bug. 
Cc: -dgreid@chromium.org
Labels: M-52
Owner: dgreid@chromium.org
Status: Assigned (was: Unconfirmed)
Thanks for the report.

http://feedback/#/Report/10014675575
Project Member

Comment 5 by sheriffbot@chromium.org, Jun 11 2016

Labels: -M-52 M-53 MovedFrom-52
Moving this nonessential bug to the next milestone.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Comment 6 by dgreid@chromium.org, Jun 15 2016

Owner: benzh@chromium.org
Project Member

Comment 7 by sheriffbot@chromium.org, Jul 6 2016

Labels: -M-53 -Pri-1 M-54 MovedFrom-53 Pri-2
This issue is Pri-1 but has already been moved once. Lowering the priority and moving to the next milestone.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Status: Archived (was: Assigned)
Owner: avkodipelli@chromium.org
Status: Untriaged (was: Archived)
Let's try a quick repro on ToT or close. 
Cc: vsu...@chromium.org hsiangc@chromium.org
Labels: -M-54 M-58
Owner: dgreid@chromium.org
Issue is still observed on 9334.11.0, 58.0.3029.19.
Repo steps:
1, enable "ok google"
2, play any music, ex: https://www.youtube.com/watch?v=be1jJCH32OU
3, Observe music
4, open new tab
5, Observe audio

Result:
- Audio playback interrupts for a moment(very quick interrupt)

Feedback report: 55097684311
avkodipelli, which platform did you test on?
cyan device.
Labels: -M-58 M-59
Owner: chinyue@chromium.org
Won't be fixed for 58.

59 if it doesn't interfere with Kevin work.
Owner: hychao@chromium.org
Status: Assigned (was: Untriaged)
Hsinyu has done the porting of the chromium patches recently on 4.4.
Similar work is needed on 3.18.
Labels: -M-59 M-60
Owner: wuchengli@chromium.org
I've done similar porting to 4.4 (context b/35585620 ). Now we need same work on 3.10. Thanks!

Steps:
1. Play YouTube in background.
2. In console, execute 'cras_test_client --capture_file /tmp/1'
3. Should observe audio dropped for a short while.
Cc: hychao@chromium.org cychiang@chromium.org
We need same work on "3.18", not 3.10

 http://crbug.com/415156  tracked the work cychiang@ has done on 3.10.
Status: Started (was: Assigned)
I can reproduce the issue on cyan M59 9390.0.0.
There was no conflict when I cherry-picked the following two patches. I tested on cyan and the issue was fixed.
https://chromium-review.googlesource.com/431016 CHROMIUM: ASoC: max98090: Remove msleep between codec turn off/on 
https://chromium-review.googlesource.com/431017 CHROMIUM: ASoC: max98090: Enable DMIC at playback when selected. 

I uploaded the patches.
https://chromium-review.googlesource.com/c/479516/
https://chromium-review.googlesource.com/c/479517/

How can I write a test for this?
The steps to enable hotwording is not automated.
We can use simple test cases like:

1. Play a sine tone.
2. Record the audio using chameleon line-in at the same time.
3. Select input to be dmic
4. Start recording from dmic
5. Check the audio recorded by chameleon, make sure there is no audio drop.


When I tested these two patches, I ran into another issue twice. The sound was completely silent. Here are the logs.

2017-04-20T17:55:31.387837+08:00 DEBUG kernel: [ 2182.514924] writing to lpe: 00000000: 01 01 01 01 00 00 08 00 ff ff ff ff 0e 00 00 00  ................
2017-04-20T17:55:32.388190+08:00 ERR kernel: [ 2183.514963] intel_sst_acpi 808622A8:00: Wait timed-out condition:0x0, msg_id:0x1 fw_state 0x3
2017-04-20T17:55:32.388233+08:00 ERR kernel: [ 2183.514994] intel_sst_acpi 808622A8:00: fw returned err -16
2017-04-20T17:55:32.388241+08:00 DEBUG kernel: [ 2183.515036] writing to lpe: 00000000: 01 02 01 03 00 00 14 00 ff ff ff ff 21 00 0c 00  ............!...
2017-04-20T17:55:32.388247+08:00 DEBUG kernel: [ 2183.515041] writing to lpe: 00000010: 01 00 00 90 67 00 60 fa 60 fa 32 00              ....g.`.`.2.
2017-04-20T17:55:33.387897+08:00 ERR kernel: [ 2184.514814] intel_sst_acpi 808622A8:00: Wait timed-out condition:0x0, msg_id:0x2 fw_state 0x3
2017-04-20T17:55:33.387940+08:00 ERR kernel: [ 2184.514837] intel_sst_acpi 808622A8:00: fw returned err -16
2017-04-20T17:55:33.387947+08:00 ERR kernel: [ 2184.514861] intel_sst_acpi 808622A8:00: free stream returned err -19
2017-04-20T17:55:33.387953+08:00 DEBUG kernel: [ 2184.515373] writing to lpe: 00000000: 01 01 01 01 00 00 0a 00 ff 8d ff ff 77 00 02 00  ............w...
2017-04-20T17:55:33.387958+08:00 DEBUG kernel: [ 2184.515379] writing to lpe: 00000010: 00 00                                            ..
2017-04-20T17:55:34.387857+08:00 ERR kernel: [ 2185.514804] intel_sst_acpi 808622A8:00: Wait timed-out condition:0x0, msg_id:0x1 fw_state 0x3
2017-04-20T17:55:34.387901+08:00 ERR kernel: [ 2185.514827] intel_sst_acpi 808622A8:00: fw returned err -16
2017-04-20T17:55:34.387909+08:00 DEBUG kernel: [ 2185.514848] writing to lpe: 00000000: 01 01 01 03 00 00 0a 00 ff 12 ff ff 77 00 02 00  ............w...
2017-04-20T17:55:34.387915+08:00 DEBUG kernel: [ 2185.514852] writing to lpe: 00000010: 00 00                                            ..
2017-04-20T17:55:35.388030+08:00 ERR kernel: [ 2186.514906] intel_sst_acpi 808622A8:00: Wait timed-out condition:0x0, msg_id:0x1 fw_state 0x3
2017-04-20T17:55:35.388083+08:00 ERR kernel: [ 2186.514932] intel_sst_acpi 808622A8:00: fw returned err -16
2017-04-20T17:55:35.399801+08:00 DEBUG kernel: [ 2186.527496] writing to lpe: 00000000: 01 01 01 01 00 00 14 00 ff ff ff ff 72 00 0c 00  ............r...
2017-04-20T17:55:35.399853+08:00 DEBUG kernel: [ 2186.527507] writing to lpe: 00000010: ff 02 ff ff 00 00 01 00 ff 8d ff ff              ............
2017-04-20T17:55:36.399848+08:00 ERR kernel: [ 2187.527037] intel_sst_acpi 808622A8:00: Wait timed-out condition:0x0, msg_id:0x1 fw_state 0x3
2017-04-20T17:55:36.399898+08:00 ERR kernel: [ 2187.527062] intel_sst_acpi 808622A8:00: fw returned err -16
2017-04-20T17:55:36.399907+08:00 DEBUG kernel: [ 2187.527088] writing to lpe: 00000000: 01 01 01 03 00 00 14 00 ff ff ff ff 72 00 0c 00  ............r...
2017-04-20T17:55:36.399914+08:00 DEBUG kernel: [ 2187.527094] writing to lpe: 00000010: ff 12 ff ff 00 00 01 00 ff 90 ff ff              ............
2017-04-20T17:55:37.399914+08:00 ERR kernel: [ 2188.527001] intel_sst_acpi 808622A8:00: Wait timed-out condition:0x0, msg_id:0x1 fw_state 0x3
2017-04-20T17:55:37.399964+08:00 ERR kernel: [ 2188.527025] intel_sst_acpi 808622A8:00: fw returned err -16
2017-04-20T17:55:37.414109+08:00 DEBUG kernel: [ 2188.541478] writing to lpe: 00000000: 01 01 01 01 00 00 08 00 ff ff ff ff 55 00 00 00  ............U...
2017-04-20T17:55:38.413797+08:00 ERR kernel: [ 2189.540887] intel_sst_acpi 808622A8:00: Wait timed-out condition:0x0, msg_id:0x1 fw_state 0x3
2017-04-20T17:55:38.413860+08:00 ERR kernel: [ 2189.540913] intel_sst_acpi 808622A8:00: fw returned err -16
2017-04-20T17:55:38.493847+08:00 ERR kernel: [ 2189.621237] intel_sst_acpi 808622A8:00: FW sent error response 0x40015
2017-04-20T17:55:38.493891+08:00 ERR kernel: [ 2189.621288] intel_sst_acpi 808622A8:00: FW sent error response 0x40006
2017-04-20T17:55:38.494783+08:00 INFO kernel: [ 2189.622042] sst-mfld-platform sst-mfld-platform: Enter: enable=1 port_name=ssp2-port
2017-04-20T17:55:38.494817+08:00 DEBUG kernel: [ 2189.622061] writing to lpe: 00000000: 01 01 01 01 00 00 1a 00 ff ff ff ff 75 00 12 00  ............u...
2017-04-20T17:55:38.494842+08:00 DEBUG kernel: [ 2189.622065] writing to lpe: 00000010: 03 00 03 00 90 00 03 ff 03 ff 03 00 00 00 10 00  ................
2017-04-20T17:55:38.494850+08:00 DEBUG kernel: [ 2189.622069] writing to lpe: 00000020: 01 00                                            ..
2017-04-20T17:55:38.500787+08:00 INFO kernel: [ 2189.628209] intel_sst_acpi 808622A8:00: Alloc for str 1 pipe 0x90
2017-04-20T17:55:38.501776+08:00 DEBUG kernel: [ 2189.629172] writing to lpe: 00000000: 01 02 01 01 00 00 1e 00 ff ff ff ff 82 00 16 00  ................
2017-04-20T17:55:38.501812+08:00 DEBUG kernel: [ 2189.629179] writing to lpe: 00000010: 82 00 12 00 03 00 01 02 04 08 10 20 40 80 01 02  ........... @...
2017-04-20T17:55:38.501819+08:00 DEBUG kernel: [ 2189.629183] writing to lpe: 00000020: 04 08 10 20 40 80                                ... @.
2017-04-20T17:55:38.501825+08:00 DEBUG kernel: [ 2189.629486] writing to lpe: 00000000: 01 02 01 01 00 00 14 00 ff ff ff ff 21 00 0c 00  ............!...
2017-04-20T17:55:38.501830+08:00 DEBUG kernel: [ 2189.629490] writing to lpe: 00000010: 01 00 00 02 67 00 00 00 00 00 32 00              ....g.....2.
2017-04-20T17:55:38.502789+08:00 DEBUG kernel: [ 2189.629930] writing to lpe: 00000000: 01 01 01 01 00 00 14 00 ff ff ff ff 72 00 0c 00  ............r...
2017-04-20T17:55:38.502823+08:00 DEBUG kernel: [ 2189.629936] writing to lpe: 00000010: ff 02 ff ff 03 00 01 00 ff 8d ff ff              ............
2017-04-20T17:55:38.502830+08:00 DEBUG kernel: [ 2189.630189] writing to lpe: 00000000: 01 01 01 03 00 00 14 00 ff ff ff ff 72 00 0c 00  ............r...
2017-04-20T17:55:38.502834+08:00 DEBUG kernel: [ 2189.630194] writing to lpe: 00000010: ff 12 ff ff 03 00 01 00 ff 90 ff ff              ............
2017-04-20T17:55:38.502840+08:00 DEBUG kernel: [ 2189.630414] writing to lpe: 00000000: 01 01 01 03 00 00 0a 00 ff 12 ff ff 77 00 02 00  ............w...
2017-04-20T17:55:38.502844+08:00 DEBUG kernel: [ 2189.630418] writing to lpe: 00000010: 01 00                                            ..
2017-04-20T17:55:38.503783+08:00 DEBUG kernel: [ 2189.630893] writing to lpe: 00000000: 01 01 01 01 00 00 0a 00 ff 8d ff ff 77 00 02 00  ............w...
2017-04-20T17:55:38.503824+08:00 DEBUG kernel: [ 2189.630899] writing to lpe: 00000010: 01 00                                            ..
2017-04-20T17:55:38.504117+08:00 DEBUG kernel: [ 2189.631119] writing to lpe: 00000000: 01 02 01 01 00 00 14 00 ff ff ff ff 21 00 0c 00  ............!...
2017-04-20T17:55:38.504131+08:00 DEBUG kernel: [ 2189.631125] writing to lpe: 00000010: 01 00 00 8d 67 00 00 00 00 00 32 00              ....g.....2.
2017-04-20T17:55:38.504151+08:00 DEBUG kernel: [ 2189.631758] writing to lpe: 00000000: 01 02 01 03 00 00 14 00 ff ff ff ff 21 00 0c 00  ............!...
2017-04-20T17:55:38.504159+08:00 DEBUG kernel: [ 2189.631764] writing to lpe: 00000010: 01 00 00 90 67 00 00 00 00 00 32 00              ....g.....2.

messages.bad
206 KB Download
messages.good
333 KB Download
audio_diagnostics_bad
678 KB View Download
audio_diagnostics_good
678 KB View Download
Cc: mac.chi...@intel.com
Hi Mac, could you please check the error logs in #20 ?
From the log, the control contents are all the same in good and bad cases.
Audio thread log also shows samples were written to device properly.
There were errors in intel_sst_acpi, but we are not sure how to trigger it.
As I understand, we just played youtube and do playback and record using cras_test_client.
The two CLs to fix the audio interrupts are in codec driver, so it might be unrelated to intel_sst_acpi.

Thanks!

Comment 23 by dymp...@gmail.com, Apr 20 2017

#CBC-RS/TC-watchlist 
Owner: cychiang@chromium.org
Status: Available (was: Started)
Sorry. I don't have time to work on this.
Labels: Hotlist-ConOps-CrOS
(Bulk Edit) Adding the new conops Chrome OS hotlist to all open issues with the "#CBC-RS/TC-watchlist" tag, our former tracking tag.
Status: Assigned (was: Available)

Sign in to add a comment