New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 598349 link

Starred by 0 users

Issue metadata

Status: Duplicate
Merged: issue 598009
Owner: ----
Closed: Mar 2016
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

GpuCrash.GPUProcessCrashesExactlyOnce is flaky

Project Member Reported by sorin@chromium.org, Mar 28 2016

Issue description

The test GpuCrash.GPUProcessCrashesExactlyOnce seems flaky on this bot:
https://build.chromium.org/p/chromium.gpu/builders/Win7%20Release%20%28NVIDIA%29

context_lost_tests on NVIDIA GPU on Windows on Windows-2008ServerR2-SP1 context_lost_tests on NVIDIA GPU on Windows on Windows-2008ServerR2-SP1 
failures:
GpuCrash.GPUProcessCrashesExactlyOnce


[ RUN      ] GpuCrash.GPUProcessCrashesExactlyOnce
(INFO) 2016-03-28 09:50:44,483 desktop_browser_backend.GetBrowserStartupArgs:272  Requested remote debugging port: 0
(INFO) 2016-03-28 09:50:44,529 desktop_browser_backend.Start:306  Starting Chrome ['c:\\users\\chrome~1\\appdata\\local\\temp\\runfxulqg\\out\\Release\\chrome.exe', '--js-flags=--expose-gc', '--enable-logging=stderr', '--disable-domain-blocking-for-3d-apis', '--disable-gpu-process-crash-limit', '--enable-gpu-benchmarking', '--enable-net-benchmarking', '--metrics-recording-only', '--no-default-browser-check', '--no-first-run', '--enable-gpu-benchmarking', '--disable-background-networking', '--no-proxy-server', '--disable-component-extensions-with-background-pages', '--disable-default-apps', '--remote-debugging-port=0', '--enable-crash-reporter-for-testing', '--window-size=1280,1024', '--user-data-dir=c:\\users\\chrome~1\\appdata\\local\\temp\\tmpotnksp\\tmprlqi7o', 'about:blank']
(INFO) 2016-03-28 09:50:44,936 desktop_browser_backend.HasBrowserFinishedLaunching:259  Discovered ephemeral port 61824
(INFO) 2016-03-28 09:50:44,947 shared_page_state._StartBrowser:198  OS: win win7
[3916:3648:0328/095044:WARNING:shell.cc(299)] Instance: exe:chrome attempting to register an instance for a process it created for target: exe:chrome_renderer without the mojo:shell{client_process} capability class.
(INFO) 2016-03-28 09:50:49,763 shared_page_state._StartBrowser:205  GPU device 0: VENDOR = 0x10de (Nvidia), DEVICE = 0x104a
(INFO) 2016-03-28 09:50:49,763 shared_page_state._StartBrowser:207  GPU Attributes:
(INFO) 2016-03-28 09:50:49,763 shared_page_state._StartBrowser:209    adapter_luid        : 0.0
(INFO) 2016-03-28 09:50:49,763 shared_page_state._StartBrowser:209    amd_switchable      : False
(INFO) 2016-03-28 09:50:49,763 shared_page_state._StartBrowser:209    basic_info_state    : 1
(INFO) 2016-03-28 09:50:49,763 shared_page_state._StartBrowser:209    can_lose_context    : False
(INFO) 2016-03-28 09:50:49,763 shared_page_state._StartBrowser:209    context_info_state  : 1
(INFO) 2016-03-28 09:50:49,763 shared_page_state._StartBrowser:209    direct_rendering    : True
(INFO) 2016-03-28 09:50:49,763 shared_page_state._StartBrowser:209    driver_date         : 3-13-2015
(INFO) 2016-03-28 09:50:49,763 shared_page_state._StartBrowser:209    driver_vendor       : NVIDIA
(INFO) 2016-03-28 09:50:49,763 shared_page_state._StartBrowser:209    driver_version      : 9.18.13.4788
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    dx_diagnostics_info_state: 0
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    encrypted_only      : False
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    gl_extensions       : GL_OES_element_index_uint GL_OES_packed_depth_stencil GL_OES_get_program_binary GL_OES_rgb8_rgba8 GL_EXT_texture_format_BGRA8888 GL_EXT_read_format_bgra GL_NV_pixel_buffer_object GL_OES_mapbuffer GL_EXT_map_buffer_range GL_EXT_color_buffer_half_float GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_float GL_OES_texture_float_linear GL_EXT_texture_rg GL_EXT_texture_compression_dxt1 GL_ANGLE_texture_compression_dxt3 GL_ANGLE_texture_compression_dxt5 GL_OES_compressed_ETC1_RGB8_texture GL_EXT_sRGB GL_ANGLE_depth_texture GL_OES_depth32 GL_EXT_texture_storage GL_OES_texture_npot GL_EXT_draw_buffers GL_EXT_texture_filter_anisotropic GL_EXT_occlusion_query_boolean GL_NV_fence GL_EXT_disjoint_timer_query GL_EXT_robustness GL_EXT_blend_minmax GL_ANGLE_framebuffer_blit GL_ANGLE_framebuffer_multisample GL_ANGLE_instanced_arrays GL_ANGLE_pack_reverse_row_order GL_OES_standard_derivatives GL_EXT_shader_texture_lod GL_EXT_frag_depth GL_ANGLE_texture_usage GL_ANGLE_translated_shader_source GL_EXT_discard_framebuffer GL_EXT_debug_marker GL_OES_EGL_image GL_EXT_unpack_subimage GL_NV_pack_subimage GL_OES_vertex_array_object GL_KHR_debug GL_ANGLE_lossy_etc_decode 
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    gl_renderer         : ANGLE (NVIDIA GeForce GT 610  Direct3D11 vs_5_0 ps_5_0)
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    gl_reset_notification_strategy: 33362
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    gl_vendor           : Google Inc.
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    gl_version          : OpenGL ES 2.0 (ANGLE 2.1.0.00f394ec669f)
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    gl_ws_extensions    : EGL_EXT_create_context_robustness EGL_ANGLE_d3d_share_handle_client_buffer EGL_ANGLE_surface_d3d_texture_2d_share_handle EGL_ANGLE_query_surface_pointer EGL_ANGLE_window_fixed_size EGL_ANGLE_keyed_mutex EGL_ANGLE_surface_orientation EGL_NV_post_sub_buffer EGL_KHR_create_context EGL_EXT_device_query EGL_KHR_image EGL_KHR_image_base EGL_KHR_gl_texture_2D_image EGL_KHR_gl_texture_cubemap_image EGL_KHR_gl_renderbuffer_image EGL_KHR_get_all_proc_addresses EGL_ANGLE_flexible_surface_compatibility 
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    gl_ws_vendor        : Google Inc. (adapter LUID: 0000000000007b45)
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    gl_ws_version       : 1.4 (ANGLE 2.1.0.00f394ec669f)
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    in_process_gpu      : False
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    initialization_time : 4.756154
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    jpeg_decode_accelerator_supported: False
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    lenovo_dcute        : False
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    max_msaa_samples    : 8
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    max_resolution_height: 1088
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    max_resolution_width: 1920
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    min_resolution_height: 48
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    min_resolution_width: 48
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    optimus             : False
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    pixel_shader_version: 5.0
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    process_crash_count : 0
(INFO) 2016-03-28 09:50:49,765 shared_page_state._StartBrowser:209    profile             : 12
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:209    sandboxed           : True
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:209    software_rendering  : False
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:209    vertex_shader_version: 5.0
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:209    video_decode_accelerator_flags: 0
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:211  Feature Status:
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:213    2d_canvas           : enabled
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:213    flash_3d            : enabled
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:213    flash_stage3d       : enabled
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:213    flash_stage3d_baseline: enabled
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:213    gpu_compositing     : enabled
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:213    multiple_raster_threads: enabled_on
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:213    native_gpu_memory_buffers: disabled_software
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:213    rasterization       : disabled_software
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:213    video_decode        : enabled
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:213    video_encode        : enabled
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:213    webgl               : enabled
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:215  Driver Bug Workarounds:
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:217    clear_uniforms_before_first_program_use
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:217    disable_direct_composition
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:217    disable_discard_framebuffer
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:217    exit_on_context_lost
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:217    force_cube_complete
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:217    scalarize_vec_and_mat_constructor_args
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:217    texsubimage_faster_than_teximage
(INFO) 2016-03-28 09:50:49,766 shared_page_state._StartBrowser:217    use_current_program_after_successful_link
[3916:3648:0328/095051:INFO:CONSOLE(29)] "Harness injected.", source:  (29)
[3916:3648:0328/095051:WARNING:shell.cc(299)] Instance: exe:chrome attempting to register an instance for a process it created for target: exe:chrome_renderer without the mojo:shell{client_process} capability class.
Backtrace:
	IsSandboxedProcess [0x631D5CDB+2823563]
	IsSandboxedProcess [0x631D4E4E+2819838]
	IsSandboxedProcess [0x631D5B26+2823126]
	ovly_debug_event [0x62B2C643+1312707]
	IsSandboxedProcess [0x631D6563+2825747]
	GetHandleVerifier [0x61ABAB9B+343323]
	ovly_debug_event [0x62B38AD6+1363030]
	GetHandleVerifier [0x61A927F7+178551]
	GetHandleVerifier [0x61A68890+6672]
	GetHandleVerifier [0x61A68343+5315]
	GetHandleVerifier [0x61A9358A+182026]
	GetHandleVerifier [0x61A93AB6+183350]
	GetHandleVerifier [0x61A685B1+5937]
	GetHandleVerifier [0x61A6858D+5901]
	IsSandboxedProcess [0x631D489E+2818382]
	ChromeMain [0x61A443B1+589457]
	ChromeMain [0x61A44286+589158]
	ChromeMain [0x61A416D3+577971]
	ChromeMain [0x619B458B+107]
	GetUploadedReportsImpl [0x00F76B7D+2877]
	GetUploadedReportsImpl [0x00F763EB+939]
	IsSandboxedProcess [0x00FCF4AF+190191]
	BaseThreadInitThunk [0x7755336A+18]
	RtlInitializeExceptionChain [0x77E192B2+99]
	RtlInitializeExceptionChain [0x77E19285+54]
[0328/095052:ERROR:process_info.cc(608)] range at 0xfffde000, size 0x230 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfffdd000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfffda000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfffd7000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfffac000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfffaf000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfffa9000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfffa6000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfffa3000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfffa0000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfff9d000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfff9a000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfff97000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfff94000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfff91000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfff8e000, size 0xf84 fully unreadable
[0328/095052:ERROR:process_info.cc(608)] range at 0xfff8b000, size 0xf84 fully unreadable
[1980:1700:0328/095052:ERROR:command_buffer_proxy_impl.cc(196)] Could not send GpuCommandBufferMsg_Initialize.
[1980:1700:0328/095052:ERROR:webgraphicscontext3d_command_buffer_impl.cc(198)] CommandBufferProxy::Initialize failed.
[1980:1700:0328/095052:ERROR:webgraphicscontext3d_command_buffer_impl.cc(217)] Failed to initialize command buffer.
[3916:3648:0328/095052:INFO:CONSOLE(0)] "WebGL: CONTEXT_LOST_WEBGL: loseContext: context lost", source: http://127.0.0.1:61832/gpu_process_crash.html (0)
Tab crashed while navigating to chrome://gpucrash
Waiting for page to finish.
Traceback (most recent call last):
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\story_runner.py", line 84, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\content\test\gpu\gpu_tests\gpu_test_base.py", line 111, in RunStory
    RunStoryWithRetries(GpuSharedPageState, self, results)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\content\test\gpu\gpu_tests\gpu_test_base.py", line 72, in RunStoryWithRetries
    super(cls, shared_page_state).RunStory(results)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\page\shared_page_state.py", line 338, in RunStory
    self._current_page, self._current_tab, results)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\content\test\gpu\gpu_tests\context_lost.py", line 116, in ValidateAndMeasurePage
    'window.domAutomationController._succeeded'):
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\browser\web_contents.py", line 162, in EvaluateJavaScript
    expr, context_id=None, timeout=timeout)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\browser\web_contents.py", line 190, in EvaluateJavaScriptInContext
    expr, context_id=context_id, timeout=timeout)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py", line 35, in inner
    inspector_backend._ConvertExceptionFromInspectorWebsocket(e)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py", line 32, in inner
    return func(inspector_backend, *args, **kwargs)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py", line 203, in EvaluateJavaScript
    return self._runtime.Evaluate(expr, context_id, timeout)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_runtime.py", line 45, in Evaluate
    res = self._inspector_websocket.SyncRequest(request, timeout)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_websocket.py", line 110, in SyncRequest
    res = self._Receive(timeout)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_websocket.py", line 149, in _Receive
    data = self._socket.recv()
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\third_party\websocket-client\websocket.py", line 596, in recv
    opcode, data = self.recv_data()
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\third_party\websocket-client\websocket.py", line 606, in recv_data
    frame = self.recv_frame()
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\third_party\websocket-client\websocket.py", line 637, in recv_frame
    self._frame_header = self._recv_strict(2)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\third_party\websocket-client\websocket.py", line 746, in _recv_strict
    bytes = self._recv(shortage)
  File "c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\third_party\websocket-client\websocket.py", line 732, in _recv
    raise WebSocketTimeoutException(e.message)
TimeoutException: 
********************************************************************************
(c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py:315 _ConvertExceptionFromInspectorWebsocket) The app is probably crashed:

Stack Trace:
********************************************************************************
	No crash dump found.
********************************************************************************
Standard output:
********************************************************************************
********************************************************************************
********************************************************************************
(c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py:320 _ConvertExceptionFromInspectorWebsocket) Original exception:
timed out
********************************************************************************
(c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py:341 _AddDebuggingInformation) Received a socket error in the browser connection and the tab still exists. The operation probably timed out.
********************************************************************************
(c:\users\chrome~1\appdata\local\temp\runfxulqg\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py:342 _AddDebuggingInformation) Debugger url: ws://127.0.0.1:61824/devtools/page/A4DCB7E8-664D-4440-9109-BBFAEBB79849

Can't get standard output with --show-stdout
Can't get standard output with --show-stdout
Can't get standard output with --show-stdout
Can't get standard output with --show-stdout
(INFO) 2016-03-28 09:56:57,299 exception_formatter.PrintFormattedException:20  Try printing formatted exception: None None None

Exception raised when cleaning story run: 

Traceback (most recent call last):
  _RunStoryAndProcessErrorIfNeeded at third_party\catapult\telemetry\telemetry\internal\story_runner.py:104
    state.DidRunStory(results)
  DidRunStory at third_party\catapult\telemetry\telemetry\page\shared_page_state.py:169
    self._current_tab.Close()
  Close at third_party\catapult\telemetry\telemetry\internal\browser\tab.py:94
    self._tab_list_backend.CloseTab(self.id)
  CloseTab at third_party\catapult\telemetry\telemetry\internal\backends\chrome\tab_list_backend.py:66
    util.WaitFor(lambda: tab_id not in self.IterContextIds(), timeout=5)
  WaitFor at third_party\catapult\telemetry\telemetry\core\util.py:94
    (timeout, GetConditionString()))
TimeoutException: Timed out while waiting 5s for util.WaitFor(lambda: tab_id not in self.IterContextIds(), timeout=5).

Locals:
  GetConditionString       : <function GetConditionString at 0x039220F0>
  condition                : <function <lambda> at 0x03CD4030>
  elapsed_time             : 5.134000062942505
  last_output_elapsed_time : 5.134000062942505
  last_output_time         : 1459184212.166
  max_poll_interval        : 5
  min_poll_interval        : 0.1
  now                      : 1459184217.3
  output_interval          : 300
  poll_interval            : 0.46660001277923585
  res                      : False
  start_time               : 1459184212.166
  timeout                  : 5

[  FAILED  ] GpuCrash.GPUProcessCrashesExactlyOnce (372818 ms)


 

Comment 1 by kbr@chromium.org, Mar 28 2016

Mergedinto: 598009
Status: Duplicate (was: Untriaged)
Thanks for reporting this. Something seems to have broken last week to make multiple of the context_lost tests flaky. Duplicating this into the previous bug report.

Sign in to add a comment