New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 717878 link

Starred by 1 user
Status: WontFix
Owner: ----
Closed: May 2017
Cc:
m...@chromium.org
█ erickung@chromium.org
█ x...@chromium.org
mfo...@chromium.org
taku...@chromium.org
powerb@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: Windows
Pri: 2
Type: Bug



Sign in to add a comment

Audio issues when casting a video at increased speed with media-remoting ON

Reported by mariu...@gmail.com, May 3 2017 
UserAgent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:53.0) Gecko/20100101 Firefox/53.0

Example URL:
https://vimeo.com/213825705

Steps to reproduce the problem:
1. Activate media-remoting flag and restart
2. Install VideoSpeedController 
3. Open the vimeo video
4. Cast the tab
4. Press play and increase the speed to e.g. 2x (press 'D' repeteadly)
5. Enter fullscreen so that media remoting kicks in

Or same steps with addon Video Speed and key ']' to increase speed.

What is the expected behavior?
Audio is played correctly at the same speed as the video, no delay, cracks or cuts.

What went wrong?
Audio is cracking and cuts (noticeable best with headphones)

Did this work before? N/A 

Is it a problem with Flash or HTML5? HTML5

Does this work in other browsers? N/A

Chrome version: 	58.0.3029.96 (Official Build) (64-bit)  Channel: stable
OS Version: 10.0
Flash Version: Shockwave Flash 25.0 r0

Contents of chrome://gpu: 
Graphics Feature Status
Canvas: Hardware accelerated
Flash: Hardware accelerated
Flash Stage3D: Hardware accelerated
Flash Stage3D Baseline profile: Hardware accelerated
Compositing: Hardware accelerated
Multiple Raster Threads: Enabled
Native GpuMemoryBuffers: Software only. Hardware acceleration disabled
Rasterization: Hardware accelerated
Video Decode: Hardware accelerated
Video Encode: Hardware accelerated
VPx Video Decode: Software only, hardware acceleration unavailable
WebGL: Hardware accelerated
WebGL2: Hardware accelerated
Driver Bug Workarounds
clear_uniforms_before_first_program_use
decode_encode_srgb_for_generatemipmap
disable_discard_framebuffer
disable_framebuffer_cmaa
exit_on_context_lost
force_cube_complete
msaa_is_slow
scalarize_vec_and_mat_constructor_args
texsubimage_faster_than_teximage
Problems Detected
Accelerated VPx decoding is hanging on some videos.: 654111
Disabled Features: accelerated_vpx_decode
Some drivers are unable to reset the D3D device in the GPU process sandbox
Applied Workarounds: exit_on_context_lost
TexSubImage is faster for full uploads on ANGLE
Applied Workarounds: texsubimage_faster_than_teximage
Clear uniforms before first program use on all platforms: 124764, 349137
Applied Workarounds: clear_uniforms_before_first_program_use
Always rewrite vec/mat constructors to be consistent: 398694
Applied Workarounds: scalarize_vec_and_mat_constructor_args
ANGLE crash on glReadPixels from incomplete cube map texture: 518889
Applied Workarounds: force_cube_complete
On Intel GPUs MSAA performance is not acceptable for GPU rasterization: 527565
Applied Workarounds: msaa_is_slow
Framebuffer discarding can hurt performance on non-tilers: 570897
Applied Workarounds: disable_discard_framebuffer
Limited enabling of Chromium GL_INTEL_framebuffer_CMAA: 535198
Applied Workarounds: disable_framebuffer_cmaa
Disable KHR_blend_equation_advanced until cc shaders are updated: 661715
Decode and Encode before generateMipmap for srgb format textures on Windows: 634519
Applied Workarounds: decode_encode_srgb_for_generatemipmap
Native GpuMemoryBuffers have been disabled, either via about:flags or command line.
Disabled Features: native_gpu_memory_buffers
Version Information
Data exported	5/3/2017, 9:28:06 AM
Chrome version	Chrome/58.0.3029.96
Operating system	Windows NT 10.0.14393
Software rendering list version	12.20
Driver bug list version	9.36
ANGLE commit id	461d9a3060e3
2D graphics backend	Skia/58 4c81ba6ba3a3270db809bf7d4c3bc782694a56a4
Command Line Args	Files (x86)\Google\Chrome\Application\chrome.exe" --flag-switches-begin --enable-features=MediaRemoting --flag-switches-end
Driver Information
Initialization time	147
In-process GPU	false
Passthrough Command Decoder	false
Sandboxed	false
GPU0	VENDOR = 0x8086, DEVICE= 0x0416 *ACTIVE*
GPU1	VENDOR = 0x10de, DEVICE= 0x1391
Optimus	false
Optimus	false
AMD switchable	false
Desktop compositing	Aero Glass
Diagonal Monitor Size of \\.\DISPLAY1	17.2"
Driver vendor	Intel Corporation
Driver version	20.19.15.4549
Driver date	11-10-2016
Pixel shader version	5.0
Vertex shader version	5.0
Max. MSAA samples	8
Machine model name	
Machine model version	
GL_VENDOR	Google Inc.
GL_RENDERER	ANGLE (Intel(R) HD Graphics 4600 Direct3D11 vs_5_0 ps_5_0)
GL_VERSION	OpenGL ES 3.0 (ANGLE 2.1.0.461d9a3060e3)
GL_EXTENSIONS	GL_ANGLE_client_arrays GL_ANGLE_depth_texture GL_ANGLE_framebuffer_blit GL_ANGLE_framebuffer_multisample GL_ANGLE_instanced_arrays GL_ANGLE_lossy_etc_decode GL_ANGLE_pack_reverse_row_order GL_ANGLE_request_extension GL_ANGLE_robust_client_memory GL_ANGLE_texture_compression_dxt3 GL_ANGLE_texture_compression_dxt5 GL_ANGLE_texture_usage GL_ANGLE_translated_shader_source GL_CHROMIUM_bind_generates_resource GL_CHROMIUM_bind_uniform_location GL_CHROMIUM_copy_compressed_texture GL_CHROMIUM_copy_texture GL_CHROMIUM_sync_query GL_EXT_blend_minmax GL_EXT_color_buffer_float GL_EXT_color_buffer_half_float GL_EXT_debug_marker GL_EXT_discard_framebuffer GL_EXT_disjoint_timer_query GL_EXT_draw_buffers GL_EXT_frag_depth GL_EXT_map_buffer_range GL_EXT_occlusion_query_boolean GL_EXT_read_format_bgra GL_EXT_robustness GL_EXT_sRGB GL_EXT_shader_texture_lod GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_s3tc_srgb GL_EXT_texture_filter_anisotropic GL_EXT_texture_format_BGRA8888 GL_EXT_texture_norm16 GL_EXT_texture_rg GL_EXT_texture_storage GL_EXT_unpack_subimage GL_KHR_debug GL_NV_EGL_stream_consumer_external GL_NV_fence GL_NV_pack_subimage GL_NV_pixel_buffer_object GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_image_external_essl3 GL_OES_compressed_ETC1_RGB8_texture GL_OES_depth32 GL_OES_element_index_uint GL_OES_get_program_binary GL_OES_mapbuffer GL_OES_packed_depth_stencil GL_OES_rgb8_rgba8 GL_OES_standard_derivatives GL_OES_texture_float GL_OES_texture_float_linear GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_npot GL_OES_vertex_array_object
Disabled Extensions	GL_KHR_blend_equation_advanced GL_KHR_blend_equation_advanced_coherent
Window system binding vendor	Google Inc. (adapter LUID: 000000000000f990)
Window system binding version	1.4 (ANGLE 2.1.0.461d9a3060e3)
Window system binding extensions	EGL_EXT_create_context_robustness EGL_ANGLE_d3d_share_handle_client_buffer EGL_ANGLE_d3d_texture_client_buffer EGL_ANGLE_surface_d3d_texture_2d_share_handle EGL_ANGLE_query_surface_pointer EGL_ANGLE_window_fixed_size EGL_ANGLE_keyed_mutex EGL_ANGLE_surface_orientation EGL_ANGLE_direct_composition EGL_NV_post_sub_buffer EGL_KHR_create_context EGL_EXT_device_query EGL_KHR_image EGL_KHR_image_base EGL_KHR_gl_texture_2D_image EGL_KHR_gl_texture_cubemap_image EGL_KHR_gl_renderbuffer_image EGL_KHR_get_all_proc_addresses EGL_KHR_stream EGL_KHR_stream_consumer_gltexture EGL_NV_stream_consumer_gltexture_yuv EGL_ANGLE_flexible_surface_compatibility EGL_ANGLE_stream_producer_d3d_texture_nv12 EGL_ANGLE_create_context_webgl_compatibility EGL_CHROMIUM_create_context_bind_generates_resource EGL_EXT_pixel_format_float EGL_ANGLE_display_texture_share_group EGL_ANGLE_create_context_client_arrays
Direct rendering	Yes
Reset notification strategy	0x8252
GPU process crash count	0
Compositor Information
Tile Update Mode	One-copy
Partial Raster	Enabled
GpuMemoryBuffers Status
ATC	Software only
ATCIA	Software only
DXT1	Software only
DXT5	Software only
ETC1	Software only
R_8	Software only
RG_88	Software only
BGR_565	Software only
RGBA_4444	Software only
RGBX_8888	Software only
RGBA_8888	Software only
BGRX_8888	Software only
BGRA_8888	Software only
YVU_420	Software only
YUV_420_BIPLANAR	Software only
UYVY_422	Software only
Diagnostics
0
b3DAccelerationEnabled	true
b3DAccelerationExists	true
bAGPEnabled	true
bAGPExistenceValid	true
bAGPExists	true
bCanRenderWindow	true
bDDAccelerationEnabled	true
bDriverBeta	false
bDriverDebug	false
bDriverSigned	false
bDriverSignedValid	false
bNoHardware	false
dwBpp	32
dwDDIVersion	12
dwHeight	1080
dwRefreshRate	60
dwWHQLLevel	0
dwWidth	1920
iAdapter	0
lDriverSize	39863888
lMiniVddSize	0
szAGPStatusEnglish	Enabled
szAGPStatusLocalized	Enabled
szChipType	Intel(R) HD Graphics Family
szD3DStatusEnglish	Enabled
szD3DStatusLocalized	Enabled
szDACType	Internal
szDDIVersionEnglish	12
szDDIVersionLocalized	12
szDDStatusEnglish	Enabled
szDDStatusLocalized	Enabled
szDXVAHDEnglish	Supported
szDXVAModes	ModeMPEG2_A ModeMPEG2_C ModeWMV9_C ModeVC1_C
szDescription	Intel(R) HD Graphics 4600
szDeviceId	0x0416
szDeviceIdentifier	{D7B78E66-4756-11CF-3662-9232BAC2D935}
szDeviceName	\\.\DISPLAY1
szDisplayMemoryEnglish	2160 MB
szDisplayMemoryLocalized	2160 MB
szDisplayModeEnglish	1920 x 1080 (32 bit) (60Hz)
szDisplayModeLocalized	1920 x 1080 (32 bit) (60Hz)
szDriverAssemblyVersion	20.19.15.4549
szDriverAttributes	Final Retail
szDriverDateEnglish	2016-11-10 03:00:00
szDriverDateLocalized	11/10/2016 03:00:00
szDriverLanguageEnglish	English
szDriverLanguageLocalized	English
szDriverModelEnglish	WDDM 2.0
szDriverModelLocalized	WDDM 2.0
szDriverName	igdumdim64.dll,igd10iumd64.dll,igd10iumd64.dll,igd12umd64.dll
szDriverNodeStrongName	oem25.inf:5f63e534dd929195:iHSWM_w10:20.19.15.4549:pci\ven_8086&dev_0416&subsys_129d1043
szDriverSignDate	Unknown
szDriverVersion	20.19.0015.4549
szKeyDeviceID	Enum\PCI\VEN_8086&DEV_0416&SUBSYS_129D1043&REV_06
szKeyDeviceKey	\Registry\Machine\System\CurrentControlSet\Control\Video\{FFFC8536-C044-4C97-820A-1F1CBE2CD6CB}\0000
szManufacturer	Intel Corporation
szMiniVdd	unknown
szMiniVddDateEnglish	Unknown
szMiniVddDateLocalized	unknown
szMonitorMaxRes	Unknown
szMonitorName	Generic PnP Monitor
szNotesEnglish	No problems found.
szNotesLocalized	No problems found.
szOverlayEnglish	Supported
szRankOfInstalledDriver	00D10001
szRegHelpText	Unknown
szRevision	Unknown
szRevisionId	0x0006
szSubSysId	0x129D1043
szTestResultD3D7English	Not run
szTestResultD3D7Localized	Not run
szTestResultD3D8English	Not run
szTestResultD3D8Localized	Not run
szTestResultD3D9English	Not run
szTestResultD3D9Localized	Not run
szTestResultDDEnglish	Not run
szTestResultDDLocalized	Not run
szVdd	unknown
szVendorId	0x8086
1
b3DAccelerationEnabled	true
b3DAccelerationExists	true
bAGPEnabled	true
bAGPExistenceValid	false
bAGPExists	false
bCanRenderWindow	false
bDDAccelerationEnabled	true
bDriverBeta	false
bDriverDebug	false
bDriverSigned	false
bDriverSignedValid	false
bNoHardware	false
dwBpp	0
dwDDIVersion	12
dwHeight	0
dwRefreshRate	0
dwWHQLLevel	0
dwWidth	0
iAdapter	0
lDriverSize	17799424
lMiniVddSize	0
szAGPStatusEnglish	Enabled
szAGPStatusLocalized	Enabled
szChipType	GeForce GTX 850M
szD3DStatusEnglish	Enabled
szD3DStatusLocalized	Enabled
szDACType	Integrated RAMDAC
szDDIVersionEnglish	12
szDDIVersionLocalized	12
szDDStatusEnglish	Enabled
szDDStatusLocalized	Enabled
szDXVAHDEnglish	Unknown
szDXVAModes	Unknown
szDescription	NVIDIA GeForce GTX 850M
szDeviceId	0x1391
szDeviceIdentifier	Unknown
szDeviceName	Unknown
szDisplayMemoryEnglish	8102 MB
szDisplayMemoryLocalized	8102 MB
szDisplayModeEnglish	Unknown
szDisplayModeLocalized	unknown
szDriverAssemblyVersion	21.21.13.6909
szDriverAttributes	Final Retail
szDriverDateEnglish	2016-08-01 03:00:00
szDriverDateLocalized	8/1/2016 03:00:00
szDriverLanguageEnglish	English
szDriverLanguageLocalized	English
szDriverModelEnglish	WDDM 2.1
szDriverModelLocalized	WDDM 2.1
szDriverName	C:\WINDOWS\System32\DriverStore\FileRepository\nvamwu.inf_amd64_d4715679184092a8\nvd3dumx.dll,C:\WINDOWS\System32\DriverStore\FileRepository\nvamwu.inf_amd64_d4715679184092a8\nvwgf2umx.dll,C:\WINDOWS\System32\DriverStore\FileRepository\nvamwu.inf_amd64_d4715679184092a8\nvwgf2umx.dll,C:\WINDOWS\System32\DriverStore\FileRepository\nvamwu.inf_amd64_d4715679184092a8\nvwgf2umx.dll
szDriverNodeStrongName	oem165.inf:0f066de3beae7061:Section140:21.21.13.6909:pci\ven_10de&dev_1391&subsys_129d1043
szDriverSignDate	Unknown
szDriverVersion	21.21.0013.6909
szKeyDeviceID	Enum\PCI\VEN_10DE&DEV_1391&SUBSYS_129D1043&REV_A2
szKeyDeviceKey	Unknown
szManufacturer	NVIDIA
szMiniVdd	unknown
szMiniVddDateEnglish	Unknown
szMiniVddDateLocalized	unknown
szMonitorMaxRes	Unknown
szMonitorName	Unknown
szNotesEnglish	No problems found.
szNotesLocalized	No problems found.
szOverlayEnglish	Unknown
szRankOfInstalledDriver	00D10001
szRegHelpText	Unknown
szRevision	Unknown
szRevisionId	0x00A2
szSubSysId	0x129D1043
szTestResultD3D7English	Not run
szTestResultD3D7Localized	Not run
szTestResultD3D8English	Not run
szTestResultD3D8Localized	Not run
szTestResultD3D9English	Not run
szTestResultD3D9Localized	Not run
szTestResultDDEnglish	Not run
szTestResultDDLocalized	Not run
szVdd	unknown
szVendorId	0x10DE
Log Messages
GpuProcessHostUIShim: The GPU process exited normally. Everything is okay.

Some videos play fine at 2x speed, some have the audio problem.
Happens for some local videos too.

Comment 1 by mariu...@gmail.com, May 3 2017 

I think this needs to be moved to component:Internals>Cast>Streaming

Comment 2 by kavvaru@chromium.org, May 3 2017

Labels: Needs-Triage-M58

Comment 3 by dalecur...@chromium.org, May 3 2017

Cc: x...@chromium.org m...@chromium.org
Components: -Internals>Media Internals>Cast>Streaming

Comment 4 by erickung@chromium.org, May 3 2017 

Assuming VideoSpeedController does the work right, it would be nice to know what case device model it's remoting to. it can be sender or receiver bug

Comment 5 by mariu...@gmail.com, May 3 2017 

Chromecast 2, firmware 1.23.84839.

Comment 6 by zhengxiong@chromium.org, May 3 2017 

I tried this on ChromeCast 1, 2, and Ultra, and found that the audio quality at playback speed 2x was worse (some ringing/warbling artifact) on CC Ultra. However, I could not reproduce the "cracking and cuts" mentioned by the reporter. When switching from mirroring to remoting, there is the possibility of buffer underruns, which could produce audio cutoffs.

marius7x: if you pause the video after the remoting transition and allow it some time to buffer, do you still hear these audio artifacts? Can you provide a recording that demonstrates these artifacts?

Comment 7 by m...@chromium.org, May 3 2017 

Also, it would help if you know the audio codec being used. It's possible the issue only applies to certain codecs.

BTW--Does Chromecast use the normal Chrome audio stack to handle decode and signal stretching/resampling? If so, this issue should affect Chrome as well as Chromecast...might make things easier to reproduce for investigation.

Comment 8 by erickung@chromium.org, May 3 2017 

Unfortunately, Chromecast devices use OEM partner solution(including speed control/decoder/render with some resampler code).

We need to send this to OEM partner for triage.

Before that, we need to be sure the quality is only worse on Chromecast Ultra as Zhengxiong mentioned. And the audio cut doesn't refer to rebuffering.

Comment 9 by mariu...@gmail.com, May 4 2017 

There's no issue with audio when playing at increased speed in Chrome only.
There's no issue if tab casting is done without media remoting. So I have perfect sound and sync for audio when I cast the tab of Netflix, Amazon (which don't jump into media remoting mode) at 2x speed.
The audio issues also appeared for some local mp4 that are cast - during their entire playback - so I think it can't be about buffering. But this is random, I couldn't reproduce even on the same file next day.

It also happens most times that the video will jump out of remoting mode (back to playing on both screens) when played at different speed and audio gets messy. It stays fine at 1.0x-1.5x.
Another video I tested on: http://www.netweather.tv/index.cgi?action=news;storyid%3D8116;sess%3D
This one after about 1.7x starts to sound bad and eventually jumps out of remoting. I guess "something" can't keep up?

I attached a short phone video capture, best I could do: https://streamable.com/s/z1w1d/nzuoxy

Comment 10 by x...@chromium.org, May 4 2017

Cc: erickung@chromium.org
It seems that playing back was delayed on receiver side when play back rate is increased, and cause remoting fall back to mirroring. 

erickung@: Does receiver decoding support 2x playback rate? I think it might depend on the codec and resolution.

Comment 11 by m...@chromium.org, May 4 2017 

Ah. It's starting to sound like the increased playback speed increased the video frame rate beyond the maximum the device can handle. If that's the case, then our "fall-back to classic mirroring on overload" logic is tripping, which is WAI. :)

Also note, there are many other reasons the overload logic would trip (e.g., insufficient network bandwidth, data volume going into the decoder).

Comment 12 by sko...@chromium.org, May 31 2017

Status: WontFix (was: Unconfirmed)
Based on c11, it sounds like the audio issue is being caused by the Ultra not being able to keep up with the 2x playback, which eventually forces a fallback to mirroring.  So I think this is WAI from the Chrome side; the proper fix probably belongs on the receiver end.
►

Sign in to add a comment