Issue metadata
Sign in to add a comment
|
WDM Multi I/O Device - Choppy audio (Windows)
Reported by
marc.ba...@gmail.com,
Sep 25 2017
|
||||||||||||||||||||||||
Issue descriptionUserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.100 Safari/537.36 Example URL: https://www.webrtc-experiment.com/RecordRTC/ Steps to reproduce the problem: 1. Plug in a USB multi input/output audio device (Windows). 2. Open the link above, select a set of inputs from your multi-input/output driver (in my case, Prism Titan inputs 1/2). 3. Select record; then either download or note the audio recording. What is the expected behavior? I expect smooth audio; no glitches. What went wrong? The audio is choppy. The audio may also sometimes start off OK and then drift into choppiness. Note, this feature works OK in Firefox (current stable); see the attached files to compare. Did this work before? No Is it a problem with Flash or HTML5? HTML5 Does this work in other browsers? Yes Chrome version: 61.0.3163.100 Channel: stable OS Version: 10.0 Flash Version: Contents of chrome://gpu: Note: To properly save this page, select the "Webpage, Complete" option in the Save File dialog. Graphics Feature Status Canvas: Hardware accelerated CheckerImaging: Disabled Flash: Hardware accelerated Flash Stage3D: Hardware accelerated Flash Stage3D Baseline profile: Hardware accelerated Compositing: Hardware accelerated Multiple Raster Threads: Enabled Native GpuMemoryBuffers: Software only. Hardware acceleration disabled Rasterization: Hardware accelerated Video Decode: Hardware accelerated Video Encode: Hardware accelerated WebGL: Hardware accelerated WebGL2: Hardware accelerated Driver Bug Workarounds clear_uniforms_before_first_program_use decode_encode_srgb_for_generatemipmap disable_discard_framebuffer disable_dxgi_zero_copy_video disable_framebuffer_cmaa disable_nv12_dxgi_video exit_on_context_lost force_cube_complete scalarize_vec_and_mat_constructor_args texsubimage_faster_than_teximage Problems Detected Some drivers are unable to reset the D3D device in the GPU process sandbox Applied Workarounds: exit_on_context_lost TexSubImage is faster for full uploads on ANGLE Applied Workarounds: texsubimage_faster_than_teximage Clear uniforms before first program use on all platforms: 124764, 349137 Applied Workarounds: clear_uniforms_before_first_program_use Always rewrite vec/mat constructors to be consistent: 398694 Applied Workarounds: scalarize_vec_and_mat_constructor_args ANGLE crash on glReadPixels from incomplete cube map texture: 518889 Applied Workarounds: force_cube_complete Framebuffer discarding can hurt performance on non-tilers: 570897 Applied Workarounds: disable_discard_framebuffer Limited enabling of Chromium GL_INTEL_framebuffer_CMAA: 535198 Applied Workarounds: disable_framebuffer_cmaa Disable KHR_blend_equation_advanced until cc shaders are updated: 661715 Decode and Encode before generateMipmap for srgb format textures on Windows: 634519 Applied Workarounds: decode_encode_srgb_for_generatemipmap Zero-copy DXGI video hangs or displays incorrect colors on AMD drivers: 623029 Applied Workarounds: disable_dxgi_zero_copy_video NV12 DXGI video displays incorrect colors on older AMD drivers: 644293 Applied Workarounds: disable_nv12_dxgi_video Native GpuMemoryBuffers have been disabled, either via about:flags or command line. Disabled Features: native_gpu_memory_buffers Checker-imaging has been disabled via finch trial or the command line. Disabled Features: checker_imaging Version Information Data exported 25/09/2017, 16:17:33 Chrome version Chrome/61.0.3163.100 Operating system Windows NT 10.0.15063 Software rendering list version 13.10 Driver bug list version 10.29 ANGLE commit id 0d2ecb4ea992 2D graphics backend Skia/61 0eefc0552cfb5ac077560b7c2630c5bd475ea585- Command Line "C:\Program Files (x86)\Google\Chrome\Application\chrome.exe" --flag-switches-begin --flag-switches-end Driver Information Initialization time 77 In-process GPU false Passthrough Command Decoder false Supports overlays false Sandboxed false GPU0 VENDOR = 0x1002, DEVICE= 0x68f9 Optimus false Optimus false AMD switchable false Desktop compositing Aero Glass Diagonal Monitor Size of \\.\DISPLAY2 24.0" Diagonal Monitor Size of \\.\DISPLAY1 24.0" Driver vendor Advanced Micro Devices, Inc. Driver version 15.201.1151.1008 Driver date 11-4-2015 Pixel shader version 5.0 Vertex shader version 5.0 Max. MSAA samples 4 Machine model name Machine model version GL_VENDOR Google Inc. GL_RENDERER ANGLE (AMD Radeon HD 5450 Direct3D11 vs_5_0 ps_5_0) GL_VERSION OpenGL ES 3.0 (ANGLE 2.1.0.0d2ecb4ea992) GL_EXTENSIONS GL_ANGLE_client_arrays GL_ANGLE_depth_texture GL_ANGLE_framebuffer_blit GL_ANGLE_framebuffer_multisample GL_ANGLE_instanced_arrays GL_ANGLE_lossy_etc_decode GL_ANGLE_pack_reverse_row_order GL_ANGLE_program_cache_control GL_ANGLE_request_extension GL_ANGLE_robust_client_memory GL_ANGLE_robust_resource_initialization GL_ANGLE_texture_compression_dxt3 GL_ANGLE_texture_compression_dxt5 GL_ANGLE_texture_usage GL_ANGLE_translated_shader_source GL_CHROMIUM_bind_generates_resource GL_CHROMIUM_bind_uniform_location GL_CHROMIUM_color_buffer_float_rgb GL_CHROMIUM_color_buffer_float_rgba GL_CHROMIUM_copy_compressed_texture GL_CHROMIUM_copy_texture GL_CHROMIUM_sync_query GL_EXT_blend_minmax GL_EXT_color_buffer_float GL_EXT_color_buffer_half_float GL_EXT_debug_marker GL_EXT_discard_framebuffer GL_EXT_disjoint_timer_query GL_EXT_draw_buffers GL_EXT_frag_depth GL_EXT_map_buffer_range GL_EXT_occlusion_query_boolean GL_EXT_read_format_bgra GL_EXT_robustness GL_EXT_sRGB GL_EXT_shader_texture_lod GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_s3tc_srgb GL_EXT_texture_filter_anisotropic GL_EXT_texture_format_BGRA8888 GL_EXT_texture_norm16 GL_EXT_texture_rg GL_EXT_texture_storage GL_EXT_unpack_subimage GL_KHR_debug GL_NV_EGL_stream_consumer_external GL_NV_fence GL_NV_pack_subimage GL_NV_pixel_buffer_object GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_image_external_essl3 GL_OES_compressed_ETC1_RGB8_texture GL_OES_depth32 GL_OES_element_index_uint GL_OES_get_program_binary GL_OES_mapbuffer GL_OES_packed_depth_stencil GL_OES_rgb8_rgba8 GL_OES_standard_derivatives GL_OES_surfaceless_context GL_OES_texture_float GL_OES_texture_float_linear GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_npot GL_OES_vertex_array_object Disabled Extensions GL_KHR_blend_equation_advanced GL_KHR_blend_equation_advanced_coherent Window system binding vendor Google Inc. (adapter LUID: 00000000000060aa) Window system binding version 1.4 (ANGLE 2.1.0.0d2ecb4ea992) Window system binding extensions EGL_EXT_create_context_robustness EGL_ANGLE_d3d_share_handle_client_buffer EGL_ANGLE_d3d_texture_client_buffer EGL_ANGLE_surface_d3d_texture_2d_share_handle EGL_ANGLE_query_surface_pointer EGL_ANGLE_window_fixed_size EGL_ANGLE_keyed_mutex EGL_ANGLE_surface_orientation EGL_ANGLE_direct_composition EGL_NV_post_sub_buffer EGL_KHR_create_context EGL_EXT_device_query EGL_KHR_image EGL_KHR_image_base EGL_KHR_gl_texture_2D_image EGL_KHR_gl_texture_cubemap_image EGL_KHR_gl_renderbuffer_image EGL_KHR_get_all_proc_addresses EGL_KHR_stream EGL_KHR_stream_consumer_gltexture EGL_NV_stream_consumer_gltexture_yuv EGL_ANGLE_flexible_surface_compatibility EGL_ANGLE_stream_producer_d3d_texture_nv12 EGL_ANGLE_create_context_webgl_compatibility EGL_CHROMIUM_create_context_bind_generates_resource EGL_CHROMIUM_sync_control EGL_EXT_pixel_format_float EGL_KHR_surfaceless_context EGL_ANGLE_display_texture_share_group EGL_ANGLE_create_context_client_arrays EGL_ANGLE_program_cache_control Direct rendering Yes Reset notification strategy 0x8252 GPU process crash count 0 Compositor Information Tile Update Mode One-copy Partial Raster Enabled GpuMemoryBuffers Status ATC Software only ATCIA Software only DXT1 Software only DXT5 Software only ETC1 Software only R_8 Software only R_16 Software only RG_88 Software only BGR_565 Software only RGBA_4444 Software only RGBX_8888 Software only RGBA_8888 Software only BGRX_8888 Software only BGRA_8888 Software only RGBA_F16 Software only YVU_420 Software only YUV_420_BIPLANAR Software only UYVY_422 Software only Diagnostics ... loading ... Log Messages [2716:10356:0925/161715.597:WARNING:angle_platform_impl.cc(41)] : rx::HLSLCompiler::compileToBinary(224): C:\fakepath(52,8-56): warning X3571: pow(f, e) will not work for negative f, use abs(f) or conditionally handle negative values if you expect them C:\fakepath(63,9-41): warning X3571: pow(f, e) will not work for negative f, use abs(f) or conditionally handle negative values if you expect them [2716:2140:0925/161715.616:WARNING:angle_platform_impl.cc(41)] : rx::HLSLCompiler::compileToBinary(224): C:\fakepath(69,11-35): warning X3571: pow(f, e) will not work for negative f, use abs(f) or conditionally handle negative values if you expect them C:\fakepath(91,11-35): warning X3571: pow(f, e) will not work for negative f, use abs(f) or conditionally handle negative values if you expect them [2716:10356:0925/161721.770:WARNING:angle_platform_impl.cc(41)] : rx::HLSLCompiler::compileToBinary(224): C:\fakepath(49,8-56): warning X3571: pow(f, e) will not work for negative f, use abs(f) or conditionally handle negative values if you expect them C:\fakepath(60,9-41): warning X3571: pow(f, e) will not work for negative f, use abs(f) or conditionally handle negative values if you expect them GpuProcessHostUIShim: The GPU process exited normally. Everything is okay. - Using OSX (CoreAudio); the same driver works OK in Chrome on a Mac (Canary and stable) - I have not tested on Windows 7. - Sample rate of device set to 48kHz. - No extra flags set (exclusive mode, buffer etc.) - Seems to be those USB audio devices from a semi pro or pro audio nature. A standard 2x in/2x out (mono) USB audio device (like an M-Audio M-Track) is OK. I have also witnessed other users with a similar problem using semi pro / pro audio devices in Chrome; audio drifts and audio becomes choppy. - Note the attached files to compare; same USB sound card working just fine in Firefox; but choppy audio in Chrome. This is also true for other websites using Chrome.
,
Sep 25 2017
,
Sep 27 2017
Adding label TE-Hardware-Dependency, as Prism Titan inputs 1/2 as a multi-input/output driver is not available with TE-India team. Hence, requesting someone from MTV team to please have a look into the issue and adding label TE-NeedsTriageFromMTV for further investigation. Thanks...!!
,
Oct 5 2017
,
Oct 6 2017
,
Oct 9 2017
The Firefox recording doesn't sound good either (there is about a second of silence after each second of audio). Seems to me like there may be an issue interfacing with the device? Could you go to chrome://webrtc-internals, check "Enable diagnostic audio recordings", and repeat the experiment, attaching the resulting files?
,
Oct 9 2017
Oh, I see. When I played it back (using totem on my Linux machine), it was interpreted as 16 bit audio (mediainfo also gives the depth as 16 bits). When I load the file into Audacity, it's interpreted as 32 bit audio and it sounds fine. Reading the wave header 00000000 52 49 46 46 2c c0 12 00 57 41 56 45 66 6d 74 20 |RIFF,...WAVEfmt | 00000010 10 00 00 00 01 00 02 00 80 bb 00 00 00 77 01 00 |.............w..| 00000020 04 00 10 00 64 61 74 61 00 c0 12 00 00 00 00 00 |....data........| shows the bit depth as 16 (it's at offset 22).
,
Oct 9 2017
When making the debug recordings, also grab the contents the audio tab of chrome://media-internals and post here.
,
Oct 11 2017
,
Jan 1 2018
Sorry for the delay;
Here is the output from the test recording via Chrome v.65
Still the same result when recording (see attached).
Here is the output from chrome://media-internals 'audio' tab:
[
{
"17:1": {
"channel_layout": "STEREO",
"channels": 2,
"component_id": 1,
"component_type": 0,
"device_id": "{0.0.1.00000000}.{3b9a5f05-c19d-48b5-82f4-1da83b13f2b2}",
"device_type": "pcm_low_latency",
"effects": "NO_EFFECTS",
"frames_per_buffer": 441,
"owner_id": 17,
"sample_rate": 44100,
"status": "started",
"render_process_id": 39,
"web_contents_title": "Cleanfeed"
}
},
{
"17:1": {
"channel_layout": "STEREO",
"channels": 2,
"component_id": 1,
"component_type": 1,
"device_id": "default",
"device_type": "pcm_low_latency",
"effects": "NO_EFFECTS",
"frames_per_buffer": 441,
"owner_id": 17,
"sample_rate": 44100,
"status": "stopped",
"render_process_id": 39,
"web_contents_title": "Cleanfeed"
},
"17:3": {
"channel_layout": "STEREO",
"channels": 2,
"component_id": 3,
"component_type": 1,
"device_id": "default",
"device_type": "pcm_low_latency",
"effects": "NO_EFFECTS",
"frames_per_buffer": 441,
"owner_id": 17,
"sample_rate": 44100,
"status": "started",
"render_process_id": 39,
"web_contents_title": "Cleanfeed",
"volume": 1
},
"17:4": {
"channel_layout": "STEREO",
"channels": 2,
"component_id": 4,
"component_type": 1,
"device_id": "default",
"device_type": "pcm_low_latency",
"effects": "NO_EFFECTS",
"frames_per_buffer": 441,
"owner_id": 17,
"sample_rate": 44100,
"status": "stopped",
"render_process_id": 39,
"web_contents_title": "Cleanfeed"
},
"17:6": {
"channel_layout": "STEREO",
"channels": 2,
"component_id": 6,
"component_type": 1,
"device_id": "default",
"device_type": "pcm_low_latency",
"effects": "NO_EFFECTS",
"frames_per_buffer": 441,
"owner_id": 17,
"sample_rate": 44100,
"status": "started",
"render_process_id": 39,
"web_contents_title": "Cleanfeed",
"volume": 0
}
},
{
"0:7": {
"channel_layout": "STEREO",
"channels": 2,
"component_id": 7,
"component_type": 2,
"device_id": "{0.0.0.00000000}.{ca05b4f7-4496-4e7b-80a9-232752a969d4}",
"device_type": "pcm_low_latency",
"effects": "NO_EFFECTS",
"frames_per_buffer": 441,
"owner_id": 0,
"sample_rate": 44100,
"status": "started",
"volume": 1
},
"0:9": {
"channel_layout": "STEREO",
"channels": 2,
"component_id": 9,
"component_type": 2,
"device_id": "{0.0.0.00000000}.{ca05b4f7-4496-4e7b-80a9-232752a969d4}",
"device_type": "pcm_low_latency",
"effects": "NO_EFFECTS",
"frames_per_buffer": 441,
"owner_id": 0,
"sample_rate": 44100,
"status": "started",
"volume": 0
}
}
]
,
Jan 4 2018
Did you follow instructions in #6 to make this recording (diagnostic debug recording)?
,
Jan 5 2018
Please find the zip of the 'diagnostic debug recordings'.
,
Apr 10 2018
,
Apr 10 2018
,
Apr 10 2018
,
Apr 10 2018
The recordings in comment #13 sounds very much like issue 637558 - missing audio in the input compared to the output and consequently glitches and sped up audio. marc.bakos: you wrote in the other bug that Chrome 67 does not exhibit the problem. Have you tested with Chrome 66 (first version with the other bug fixed)?
,
Apr 10 2018
grunell: I have not tested with Chrome 66; let me find that version and I'll revert back to you. As I mentioned, Chrome 67 does not exhibit this issue anymore - which is great and could conclude this issue as well.
,
Apr 10 2018
OK, then it could sure be the same issue. Chrome Beta is currently at version 66. If you could test with that, it'd be great. Do you have the problem with Chrome Stable (version 65)?
,
Apr 10 2018
OK perfect - thank you. I'll download 66 this evening and give it a go (GMT). The problem still exists in 65 and before; this is also true with a lot of other users with similar sound cards I've come into contact with - other devices have been fine in previous versions. I'll report back.
,
Apr 10 2018
@grunell: Update, Chrome 66 works as expected - so it does seem related and fixed. Seemingly this looks like it was a buffer issue with certain devices on Windows(?) - but not all. I would still like to learn more about the audio layer in Chromium; mainly what clocking it's using - the use of CoreAudio (Mac) / WDM on Windows etc. Perhaps you can point me in the right direction for more information?
,
Apr 13 2018
Thanks for the update! With the similarity in the symptoms and being fixed with Chrome 66, this is very likely the same as the above mentioned issue. I'll closing this as a duplicate.
,
Apr 13 2018
Regarding Chromium's audio code, you can start looking at the platform implementations in sub-folders of https://cs.chromium.org/chromium/src/media/audio/ and work your way from there.
,
Apr 13 2018
Thank you for all your help, Grunell. |
|||||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||||
Comment 1 by dalecur...@chromium.org
, Sep 25 2017