New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 633761 link

Starred by 3 users

Issue metadata

Status: Fixed
Owner:
Closed: Aug 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Mac
Pri: 1
Type: Bug



Sign in to add a comment

core.minidump_unittest.BrowserMinidumpTest.testSymbolizeMinidump is flaky on Mac

Project Member Reported by nedngu...@google.com, Aug 2 2016

Issue description

Log:
https://build.chromium.org/p/chromium.mac/builders/Mac10.10%20Tests/builds/7722/steps/telemetry_perf_unittests/logs/stdio

[1/1] core.minidump_unittest.BrowserMinidumpTest.testSymbolizeMinidump failed unexpectedly 6.8167s:
  Chrome build location for mac_x86_64 not found. Browser will be run without Flash.
  Requested remote debugging port: 0
  Starting Chrome ['/b/c/b/Mac10_10_Tests/isolated_runYW1gdD/out/Release/Chromium.app/Contents/MacOS/Chromium', '--enable-net-benchmarking', '--metrics-recording-only', '--no-default-browser-check', '--no-first-run', '--enable-gpu-benchmarking', '--disable-background-networking', '--no-proxy-server', '--disable-component-extensions-with-background-pages', '--disable-default-apps', '--remote-debugging-port=0', '--enable-crash-reporter-for-testing', '--window-size=1280,1024', '--user-data-dir=/b/c/b/Mac10_10_Tests/isolated_tmpkgamOv/tmpZdo5SP', 'about:blank']
  Discovered ephemeral port 54607
  OS: mac yosemite
  Model: Macmini
  GPU device 0: VENDOR = 0x8086 (Intel), DEVICE = 0xa2e
  GPU Attributes:
    adapter_luid        : 0.0
    amd_switchable      : False
    basic_info_state    : 1
    can_lose_context    : False
    context_info_state  : 1
    direct_rendering    : True
    driver_date         : 
    driver_vendor       : 
    driver_version      : 10.6.33
    encrypted_only      : False
    gl_extensions       : GL_ARB_color_buffer_float GL_ARB_depth_buffer_float GL_ARB_depth_clamp GL_ARB_depth_texture GL_ARB_draw_buffers GL_ARB_draw_elements_base_vertex GL_ARB_draw_instanced GL_ARB_fragment_program GL_ARB_fragment_program_shadow GL_ARB_fragment_shader GL_ARB_framebuffer_object GL_ARB_framebuffer_sRGB GL_ARB_half_float_pixel GL_ARB_half_float_vertex GL_ARB_instanced_arrays GL_ARB_multisample GL_ARB_multitexture GL_ARB_occlusion_query GL_ARB_pixel_buffer_object GL_ARB_point_parameters GL_ARB_point_sprite GL_ARB_provoking_vertex GL_ARB_seamless_cube_map GL_ARB_shader_objects GL_ARB_shader_texture_lod GL_ARB_shading_language_100 GL_ARB_shadow GL_ARB_sync GL_ARB_texture_border_clamp GL_ARB_texture_compression GL_ARB_texture_compression_rgtc GL_ARB_texture_cube_map GL_ARB_texture_env_add GL_ARB_texture_env_combine GL_ARB_texture_env_crossbar GL_ARB_texture_env_dot3 GL_ARB_texture_float GL_ARB_texture_mirrored_repeat GL_ARB_texture_non_power_of_two GL_ARB_texture_rectangle GL_ARB_texture_rg GL_ARB_transpose_matrix GL_ARB_vertex_array_bgra GL_ARB_vertex_blend GL_ARB_vertex_buffer_object GL_ARB_vertex_program GL_ARB_vertex_shader GL_ARB_window_pos GL_EXT_abgr GL_EXT_bgra GL_EXT_blend_color GL_EXT_blend_equation_separate GL_EXT_blend_func_separate GL_EXT_blend_minmax GL_EXT_blend_subtract GL_EXT_clip_volume_hint GL_EXT_debug_label GL_EXT_debug_marker GL_EXT_draw_buffers2 GL_EXT_draw_range_elements GL_EXT_fog_coord GL_EXT_framebuffer_blit GL_EXT_framebuffer_multisample GL_EXT_framebuffer_multisample_blit_scaled GL_EXT_framebuffer_object GL_EXT_framebuffer_sRGB GL_EXT_geometry_shader4 GL_EXT_gpu_program_parameters GL_EXT_gpu_shader4 GL_EXT_multi_draw_arrays GL_EXT_packed_depth_stencil GL_EXT_packed_float GL_EXT_provoking_vertex GL_EXT_rescale_normal GL_EXT_secondary_color GL_EXT_separate_specular_color GL_EXT_shadow_funcs GL_EXT_stencil_two_side GL_EXT_stencil_wrap GL_EXT_texture_array GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_s3tc GL_EXT_texture_env_add GL_EXT_texture_filter_anisotropic GL_EXT_texture_integer GL_EXT_texture_lod_bias GL_EXT_texture_rectangle GL_EXT_texture_shared_exponent GL_EXT_texture_sRGB GL_EXT_texture_sRGB_decode GL_EXT_timer_query GL_EXT_transform_feedback GL_EXT_vertex_array_bgra GL_APPLE_aux_depth_stencil GL_APPLE_client_storage GL_APPLE_element_array GL_APPLE_fence GL_APPLE_float_pixels GL_APPLE_flush_buffer_range GL_APPLE_flush_render GL_APPLE_object_purgeable GL_APPLE_packed_pixels GL_APPLE_pixel_buffer GL_APPLE_rgb_422 GL_APPLE_row_bytes GL_APPLE_specular_vector GL_APPLE_texture_range GL_APPLE_transform_hint GL_APPLE_vertex_array_object GL_APPLE_vertex_array_range GL_APPLE_vertex_point_size GL_APPLE_vertex_program_evaluators GL_APPLE_ycbcr_422 GL_ATI_separate_stencil GL_ATI_texture_env_combine3 GL_ATI_texture_float GL_ATI_texture_mirror_once GL_IBM_rasterpos_clip GL_NV_blend_square GL_NV_conditional_render GL_NV_depth_clamp GL_NV_fog_distance GL_NV_light_max_exponent GL_NV_texgen_reflection GL_NV_texture_barrier GL_SGIS_generate_mipmap GL_SGIS_texture_edge_clamp GL_SGIS_texture_lod 
    gl_renderer         : Intel Iris OpenGL Engine
    gl_reset_notification_strategy: 0
    gl_vendor           : Intel Inc.
    gl_version          : 2.1 INTEL-10.6.33
    gl_ws_extensions    : 
    gl_ws_vendor        : 
    gl_ws_version       : 
    in_process_gpu      : False
    initialization_time : 0.033234
    jpeg_decode_accelerator_supported: False
    lenovo_dcute        : False
    max_framerate_denominator: 1
    max_framerate_numerator: 30
    max_msaa_samples    : 8
    max_resolution_height: 2160
    max_resolution_width: 4096
    min_resolution_height: 16
    min_resolution_width: 16
    optimus             : False
    pixel_shader_version: 1.20
    process_crash_count : 0
    profile             : 0
    sandboxed           : True
    software_rendering  : False
    vertex_shader_version: 1.20
    video_decode_accelerator_flags: 0
  Feature Status:
    2d_canvas           : enabled
    flash_3d            : enabled
    flash_stage3d       : enabled
    flash_stage3d_baseline: enabled
    gpu_compositing     : enabled
    multiple_raster_threads: enabled_on
    native_gpu_memory_buffers: enabled
    rasterization       : enabled
    video_decode        : enabled
    video_encode        : enabled
    vpx_decode          : enabled
    webgl               : enabled
  Driver Bug Workarounds:
    disable_framebuffer_cmaa
    disable_multimonitor_multisampling
    disable_overlay_ca_layers
    disable_webgl_rgb_multisampling_usage
    msaa_is_slow
    pack_parameters_workaround_with_pack_buffer
    regenerate_struct_names
    scalarize_vec_and_mat_constructor_args
    set_zero_level_before_generating_mipmap
    unfold_short_circuit_as_ternary_operation
    unpack_alignment_workaround_with_unpack_buffer
    use_intermediary_for_copy_texture_image
    use_shadowed_tex_level_params
    validate_multisample_buffer_allocation
  Found crashpad_database_util
  No minidump found via crashpad_database_util
  *************** BROWSER STANDARD OUTPUT ***************
  2016-08-02 10:57:20.191 Chromium[6974:43781] NSWindow warning: adding an unknown subview: <FullSizeContentView: 0x7fbb726213d0>
  2016-08-02 10:57:20.191 Chromium[6974:43781] Call stack:
  (
      "+callStackSymbols disabled for performance reasons"
  )
  Received signal 11 SEGV_MAPERR 000000000000
   [0x0001048ade86]
   [0x7fff8a594f1a]
   [0x000000000000]
   [0x000107da3072]
   [0x000107da2054]
   [0x000106b36d0a]
   [0x000107da35cb]
   [0x0001058722eb]
   [0x0001048ae49b]
   [0x0001048d060c]
   [0x0001048d091c]
   [0x0001048d0cc3]
   [0x0001048d2e3d]
   [0x0001048c687a]
   [0x0001048d2844]
   [0x7fff9141aa01]
   [0x7fff9140cb8d]
   [0x7fff9140c1bf]
   [0x7fff9140bbd8]
   [0x0001048d321f]
   [0x0001048d2c94]
   [0x0001048eddd1]
   [0x000107da6086]
   [0x00010445c140]
   [0x00010445b2c6]
   [0x000102ffa6fa]
   [0x000102fc3d6a]
   [0x000102fc3b54]
  [end of stack trace]
  
  *********** END OF BROWSER STANDARD OUTPUT ************
  ********************* BROWSER LOG *********************
  No log file
  ***************** END OF BROWSER LOG ******************
  Traceback (most recent call last):
    File "/b/c/b/Mac10_10_Tests/isolated_runYW1gdD/third_party/catapult/telemetry/telemetry/testing/browser_test_case.py", line 41, in WrappedMethod
      method(self)
    File "/b/c/b/Mac10_10_Tests/isolated_runYW1gdD/third_party/catapult/telemetry/telemetry/decorators.py", line 163, in wrapper
      func(*args, **kwargs)
    File "/b/c/b/Mac10_10_Tests/isolated_runYW1gdD/tools/perf/core/minidump_unittest.py", line 20, in testSymbolizeMinidump
      self.assertIsNotNone(crash_minidump_path)
  AssertionError: unexpectedly None

278 tests run in 1228.6s, 1 failure.

 
 Issue 633361  has been merged into this issue.
Project Member

Comment 2 by bugdroid1@chromium.org, Aug 3 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/f4e1369980c341f7aa22d59600abfff43939f53e

commit f4e1369980c341f7aa22d59600abfff43939f53e
Author: eyaich <eyaich@google.com>
Date: Wed Aug 03 00:23:31 2016

Removing remaining asserts while I debug flakiness in minidump tests.

BUG= 633761 

Review-Url: https://codereview.chromium.org/2203923003
Cr-Commit-Position: refs/heads/master@{#409398}

[modify] https://crrev.com/f4e1369980c341f7aa22d59600abfff43939f53e/tools/perf/core/minidump_unittest.py

Cc: eyaich@chromium.org
Issue 634156 has been merged into this issue.
Status: Started (was: Untriaged)
Project Member

Comment 5 by sheriffbot@chromium.org, Aug 5 2016

Labels: Hotlist-Google

Comment 6 by foolip@chromium.org, Aug 10 2016

Labels: Sheriff-Chromium
Ping eyaich@, this continues to cause frequent failures on build.chromium.org. Adding Sheriff-Chromium label so that other sheriffs know that work is ongoing.

Comment 7 by foolip@chromium.org, Aug 10 2016

The most recent failures:
https://build.chromium.org/p/chromium.mac/builders/Mac10.10%20Tests/builds/7750
https://build.chromium.org/p/chromium.mac/builders/Mac10.10%20Tests/builds/7772
https://build.chromium.org/p/chromium.mac/builders/Mac10.10%20Tests/builds/7782

It's not the top cause of flakiness on that bot, so it doesn't seem super urgent to disable, and I'm not sure if disabling it might interfere with the investigation. Next sheriff, if there doesn't seem to be any progress on this and there's another failure after build 7782, I suggest disabling the test.
Project Member

Comment 8 by bugdroid1@chromium.org, Aug 10 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/170b679ea057ed27c7f7ed6785208a7b0b512cd6

commit 170b679ea057ed27c7f7ed6785208a7b0b512cd6
Author: eyaich <eyaich@google.com>
Date: Wed Aug 10 19:42:14 2016

Making sure logging in minidump unittest is aware when string is none.

BUG= chromium:633761 

Review-Url: https://codereview.chromium.org/2235693003
Cr-Commit-Position: refs/heads/master@{#411119}

[modify] https://crrev.com/170b679ea057ed27c7f7ed6785208a7b0b512cd6/tools/perf/core/minidump_unittest.py

Comment 9 by kbr@chromium.org, Aug 10 2016

Components: Internals>CrashReporting
Is it possible there's a race condition between the creation of the minidump and the code which attempts to read it?

Comment 10 by samli@chromium.org, Aug 11 2016

Status: Fixed (was: Started)
Closing this since the last 4 hours of builds have been successful.
Project Member

Comment 11 by bugdroid1@chromium.org, Aug 12 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/ad430d0e3ed88bc0734c65e2861cd7a9e4864cce

commit ad430d0e3ed88bc0734c65e2861cd7a9e4864cce
Author: eyaich <eyaich@google.com>
Date: Fri Aug 12 09:11:14 2016

Adding in checks for all logging statements and none.

BUG= chromium:633761 

Review-Url: https://codereview.chromium.org/2241553002
Cr-Commit-Position: refs/heads/master@{#411586}

[modify] https://crrev.com/ad430d0e3ed88bc0734c65e2861cd7a9e4864cce/tools/perf/core/minidump_unittest.py

Sign in to add a comment