This is causing our bot to go red 50% of the time:
https://ci.chromium.org/buildbot/chromium.clang/ToTMac/

core.stacktrace_unittest.TabStackTraceTest.testBadBreakpadFileIgnored tends to be the culprit.

Sheriff: I don't see failure in the last 100 builds?

https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Mac10.12%20Tests?limit=100

#2: I believe that issue is separate from this. I suspect it has to do the way with Clang build works on Mac

testBadBreakpadFileIgnored failed on  Linux Tests (dbg) bot.
https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Linux%20Tests%20%28dbg%29%281%29/75364
https://chromium-swarm.appspot.com/task?id=40dbc8e98801f010&refresh=10&show_raw=1

[26/26] core.stacktrace_unittest.TabStackTraceTest.testBadBreakpadFileIgnored failed unexpectedly 106.4736s:
  Chrome build location for linux_x86_64 not found. Browser will be run without Flash.
  Chose browser: PossibleDesktopBrowser(type=debug, executable=/b/s/w/ir/out/Debug/chrome, flash=None)
  Tsproxy commandline: ['/b/s/w/ir/.swarming_module_cache/vpython/dba151/bin/python', '/b/s/w/ir/third_party/catapult/telemetry/third_party/tsproxy/tsproxy.py', '--port=0', '--desthost=127.0.0.1']
  fcntl is supported, try setting non blocking I/O for the ts_proxy process
  TsProxy port: 42315
  DoNothingForwarder started between 127.0.0.1:42315 and 42315
  Chrome Env: {'GTEST_TOTAL_SHARDS': '12', 'LOGNAME': 'chrome-bot', 'USER': 'chrome-bot', 'PATH': '/b/s/w/ir/.swarming_module_cache/vpython/dba151/bin:/b/s/w/ir/.swarming_module:/b/s/w/ir/.swarming_module/bin:/b/s/cipd_cache/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/b/s/w/ir/.swarming_module_cache/vpython/dba151/lib/python2.7/site-packages/cv2', 'SWARMING_BOT_ID': 'gce-trusty-e833d7b0-us-west1-b-tgth', 'DISPLAY': ':99', 'LANG': 'en_US.UTF-8', 'TERM': 'linux', 'SHELL': '/bin/bash', 'SWARMING_SERVER': 'https://chromium-swarm.appspot.com', 'CHROME_DEVEL_SANDBOX': '/opt/chromium/chrome_sandbox', 'SWARMING_EXTERNAL_BOT_SETUP': '1', 'SWARMING_HEADLESS': '1', 'PYTHONNOUSERSITE': '1', 'LUCI_CONTEXT': '/b/s/w/itoUWtYa/luci_ctx.9UjxHA.json', 'SUDO_USER': 'root', 'HOME': '/home/chrome-bot', 'CIPD_CACHE_DIR': '/b/s/cipd_cache/cache', 'USERNAME': 'chrome-bot', 'PYTHONPATH': '/b/s/w/ir/third_party/catapult/telemetry', 'BREAKPAD_DUMP_LOCATION': '/b/s/w/itoUWtYa/tmpOan_q7', 'SUDO_UID': '0', 'VIRTUAL_ENV': '/b/s/w/ir/.swarming_module_cache/vpython/dba151', 'GTEST_SHARD_INDEX': '0', 'VPYTHON_VIRTUALENV_ROOT': '/b/s/w/ir/.swarming_module_cache/vpython', 'SWARMING_TASK_ID': '40dbc8e98801f011', 'NO_GCE_CHECK': 'False', 'CHROME_HEADLESS': '1', 'LC_ALL': 'en_US.UTF-8', 'TMPDIR': '/b/s/w/itoUWtYa', 'XAUTHORITY': '/b/s/w/itoUWtYa/xvfb-run.CQX6ex/Xauthority', 'SUDO_COMMAND': '/usr/bin/python /b/s/swarming_bot.zip start_bot', 'SUDO_GID': '0', 'CIPD_PROTOCOL': 'v2', '_CHROMIUM_INSIDE_XVFB': '1', 'PWD': '/b/s/w/ir/out/Debug', 'MAIL': '/var/mail/chrome-bot', 'LC_MESSAGES': 'en_US.UTF-8'}
  Starting Chrome ['/b/s/w/ir/out/Debug/chrome', '--enable-net-benchmarking', '--metrics-recording-only', '--no-default-browser-check', '--no-first-run', '--ignore-background-tasks', '--enable-gpu-benchmarking', '--deny-permission-prompts', '--autoplay-policy=no-user-gesture-required', '--disable-background-networking', '--disable-component-extensions-with-background-pages', '--disable-default-apps', '--disable-search-geolocation-disclosure', '--proxy-server=socks://localhost:42315', '--ignore-certificate-errors-spki-list=PhrPvGIaAMmd29hj8BCZOq096yj7uMpRNHpn5PDxI6I=', '--remote-debugging-port=0', '--enable-crash-reporter-for-testing', '--disable-component-update', '--window-size=1280,1024', '--user-data-dir=/b/s/w/itoUWtYa/tmp4Zcyh1', 'about:blank']
  DoNothingForwarder started between 127.0.0.1:46841 and 46841
  Browser started (pid=12609).
  OS: linux ubuntu
  Browser command line: /b/s/w/ir/out/Debug/chrome --enable-net-benchmarking --metrics-recording-only --no-default-browser-check --no-first-run --ignore-background-tasks --enable-gpu-benchmarking --deny-permission-prompts --autoplay-policy=no-user-gesture-required --disable-background-networking --disable-component-extensions-with-background-pages --disable-default-apps --disable-search-geolocation-disclosure --proxy-server=socks://localhost:42315 --ignore-certificate-errors-spki-list=PhrPvGIaAMmd29hj8BCZOq096yj7uMpRNHpn5PDxI6I= --remote-debugging-port=0 --enable-crash-reporter-for-testing --disable-component-update --window-size=1280,1024 --user-data-dir=/b/s/w/itoUWtYa/tmp4Zcyh1 --flag-switches-begin --flag-switches-end about:blank
  GPU device 0: VENDOR = 0x0 (VMware, Inc.), DEVICE = 0x0 (Gallium 0.4 on llvmpipe (LLVM 3.4, 256 bits))
  GPU Attributes:
    amd_switchable      : False
    can_support_threaded_texture_mailbox: False
    direct_rendering    : True
    gl_extensions       : GL_ARB_multisample GL_EXT_abgr GL_EXT_bgra GL_EXT_blend_color GL_EXT_blend_minmax GL_EXT_blend_subtract GL_EXT_copy_texture GL_EXT_polygon_offset GL_EXT_subtexture GL_EXT_texture_object GL_EXT_vertex_array GL_EXT_compiled_vertex_array GL_EXT_texture GL_EXT_texture3D GL_IBM_rasterpos_clip GL_ARB_point_parameters GL_EXT_draw_range_elements GL_EXT_packed_pixels GL_EXT_point_parameters GL_EXT_rescale_normal GL_EXT_separate_specular_color GL_EXT_texture_edge_clamp GL_SGIS_generate_mipmap GL_SGIS_texture_border_clamp GL_SGIS_texture_edge_clamp GL_SGIS_texture_lod GL_ARB_framebuffer_sRGB GL_ARB_multitexture GL_EXT_framebuffer_sRGB GL_IBM_multimode_draw_arrays GL_IBM_texture_mirrored_repeat GL_ARB_texture_cube_map GL_ARB_texture_env_add GL_ARB_transpose_matrix GL_EXT_blend_func_separate GL_EXT_fog_coord GL_EXT_multi_draw_arrays GL_EXT_secondary_color GL_EXT_texture_env_add GL_EXT_texture_lod_bias GL_INGR_blend_func_separate GL_NV_blend_square GL_NV_light_max_exponent GL_NV_texgen_reflection GL_NV_texture_env_combine4 GL_S3_s3tc GL_SUN_multi_draw_arrays GL_ARB_texture_border_clamp GL_ARB_texture_compression GL_EXT_framebuffer_object GL_EXT_texture_compression_s3tc GL_EXT_texture_env_combine GL_EXT_texture_env_dot3 GL_MESA_window_pos GL_NV_packed_depth_stencil GL_NV_texture_rectangle GL_ARB_depth_texture GL_ARB_occlusion_query GL_ARB_shadow GL_ARB_texture_env_combine GL_ARB_texture_env_crossbar GL_ARB_texture_env_dot3 GL_ARB_texture_mirrored_repeat GL_ARB_window_pos GL_EXT_stencil_two_side GL_EXT_texture_cube_map GL_NV_depth_clamp GL_NV_fog_distance GL_APPLE_packed_pixels GL_APPLE_vertex_array_object GL_ARB_draw_buffers GL_ARB_fragment_program GL_ARB_fragment_shader GL_ARB_shader_objects GL_ARB_vertex_program GL_ARB_vertex_shader GL_ATI_draw_buffers GL_ATI_texture_env_combine3 GL_ATI_texture_float GL_EXT_shadow_funcs GL_EXT_stencil_wrap GL_MESA_pack_invert GL_MESA_ycbcr_texture GL_NV_primitive_restart GL_ARB_depth_clamp GL_ARB_fragment_program_shadow GL_ARB_half_float_pixel GL_ARB_occlusion_query2 GL_ARB_point_sprite GL_ARB_shading_language_100 GL_ARB_sync GL_ARB_texture_non_power_of_two GL_ARB_vertex_buffer_object GL_ATI_blend_equation_separate GL_EXT_blend_equation_separate GL_OES_read_format GL_ARB_color_buffer_float GL_ARB_pixel_buffer_object GL_ARB_texture_compression_rgtc GL_ARB_texture_float GL_ARB_texture_rectangle GL_ATI_texture_compression_3dc GL_EXT_packed_float GL_EXT_pixel_buffer_object GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_rgtc GL_EXT_texture_mirror_clamp GL_EXT_texture_rectangle GL_EXT_texture_sRGB GL_EXT_texture_shared_exponent GL_ARB_framebuffer_object GL_EXT_framebuffer_blit GL_EXT_packed_depth_stencil GL_ARB_vertex_array_object GL_ATI_separate_stencil GL_ATI_texture_mirror_once GL_EXT_draw_buffers2 GL_EXT_draw_instanced GL_EXT_gpu_program_parameters GL_EXT_texture_array GL_EXT_texture_compression_latc GL_EXT_texture_integer GL_EXT_texture_sRGB_decode GL_EXT_timer_query GL_OES_EGL_image GL_ARB_copy_buffer GL_ARB_depth_buffer_float GL_ARB_draw_instanced GL_ARB_half_float_vertex GL_ARB_instanced_arrays GL_ARB_map_buffer_range GL_ARB_texture_rg GL_ARB_texture_swizzle GL_ARB_vertex_array_bgra GL_EXT_texture_swizzle GL_EXT_vertex_array_bgra GL_NV_conditional_render GL_AMD_conservative_depth GL_AMD_draw_buffers_blend GL_AMD_seamless_cubemap_per_texture GL_ARB_ES2_compatibility GL_ARB_blend_func_extended GL_ARB_debug_output GL_ARB_draw_buffers_blend GL_ARB_draw_elements_base_vertex GL_ARB_explicit_attrib_location GL_ARB_fragment_coord_conventions GL_ARB_provoking_vertex GL_ARB_sampler_objects GL_ARB_seamless_cube_map GL_ARB_shader_texture_lod GL_ARB_texture_rgb10_a2ui GL_ARB_uniform_buffer_object GL_ARB_vertex_type_2_10_10_10_rev GL_EXT_provoking_vertex GL_EXT_texture_snorm GL_MESA_texture_signed_rgba GL_ARB_get_program_binary GL_ARB_robustness GL_ARB_shader_bit_encoding GL_ARB_timer_query GL_ARB_transform_feedback2 GL_ARB_transform_feedback3 GL_NV_vdpau_interop GL_ANGLE_texture_compression_dxt3 GL_ANGLE_texture_compression_dxt5 GL_ARB_conservative_depth GL_ARB_internalformat_query GL_ARB_map_buffer_alignment GL_ARB_shading_language_420pack GL_ARB_shading_language_packing GL_ARB_texture_storage GL_ARB_transform_feedback_instanced GL_EXT_transform_feedback GL_AMD_shader_trinary_minmax GL_ARB_clear_buffer_object GL_ARB_invalidate_subdata GL_ARB_vertex_attrib_binding GL_KHR_debug GL_ARB_texture_mirror_clamp_to_edge GL_ARB_vertex_type_10f_11f_11f_rev 
    gl_renderer         : Gallium 0.4 on llvmpipe (LLVM 3.4, 256 bits)
    gl_reset_notification_strategy: 33377
    gl_vendor           : VMware, Inc.
    gl_version          : 2.1 Mesa 10.1.3
    gl_ws_extensions    : GLX_ARB_multisample GLX_EXT_visual_info GLX_EXT_visual_rating GLX_EXT_import_context GLX_EXT_texture_from_pixmap GLX_OML_swap_method GLX_SGI_make_current_read GLX_SGIS_multisample GLX_SGIX_fbconfig GLX_SGIX_pbuffer GLX_MESA_copy_sub_buffer 
    gl_ws_vendor        : SGI
    gl_ws_version       : 1.4
    in_process_gpu      : False
    initialization_time : 0.128264
    jpeg_decode_accelerator_supported: False
    max_msaa_samples    : 0
    oop_rasterization_supported: False
    optimus             : False
    passthrough_cmd_decoder: False
    pixel_shader_version: 1.30
    process_crash_count : 0
    rgba_visual         : 62
    sandboxed           : False
    software_rendering  : False
    system_visual       : 33
    vertex_shader_version: 1.30
    video_decode_accelerator_flags: 0
  Feature Status:
    2d_canvas           : unavailable_software
    flash_3d            : unavailable_off
    flash_stage3d       : unavailable_off
    flash_stage3d_baseline: unavailable_off
    gpu_compositing     : unavailable_off
    multiple_raster_threads: enabled_on
    native_gpu_memory_buffers: disabled_software
    oop_rasterization   : unavailable_off
    protected_video_decode: unavailable_off
    rasterization       : unavailable_off
    skia_deferred_display_list: disabled_off
    skia_renderer       : disabled_off
    surface_control     : disabled_off
    surface_synchronization: enabled_on
    video_decode        : unavailable_off
    viz_display_compositor: enabled_on
    webgl               : enabled_readback
    webgl2              : unavailable_off
  Driver Bug Workarounds:
    clear_uniforms_before_first_program_use
    count_all_in_varyings_packing
    decode_encode_srgb_for_generatemipmap
    disable_framebuffer_cmaa
    disable_post_sub_buffers_for_onscreen_surfaces
    disable_texture_storage
    disable_timestamp_queries
    scalarize_vec_and_mat_constructor_args
    disabled_extension__gl__arb_timer_query
    disabled_extension__gl__ext_disjoint_timer_query
    disabled_extension__gl__ext_disjoint_timer_query_webgl2
    disabled_extension__gl__ext_timer_query
    disabled_extension__gl__khr_blend_equation_advanced
    disabled_extension__gl__khr_blend_equation_advanced_coherent
  No path to crashpad_database_util found
  No minidump found via crashpad_database_util
  Found minidump via globbing in minidump dir
  Minidump found: /b/s/w/itoUWtYa/tmpOan_q7/chromium-renderer-minidump-7ba47301bbab176c.dmp
  Uploading /b/s/w/itoUWtYa/tmpOan_q7/chromium-renderer-minidump-7ba47301bbab176c.dmp to gs://chrome-telemetry-output/minidump-2018-10-29_20-30-13-17916.dmp
  Dumping breakpad symbols.
  No path to crashpad_database_util found
  No minidump found via crashpad_database_util
  *************** BROWSER STANDARD OUTPUT ***************
  
  *********** END OF BROWSER STANDARD OUTPUT ************
  ********************* BROWSER LOG *********************
  No log file
  ***************** END OF BROWSER LOG ******************
  ********************* SYMBOLIZED MINIDUMP *********************
  No path to crashpad_database_util found
  No minidump found via crashpad_database_util
  ***************** END OF SYMBOLIZED MINIDUMP ******************
  Closing browser (pid=12609) ...
  Traceback (most recent call last):
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/testing/browser_test_case.py", line 39, in WrappedMethod
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/decorators.py", line 219, in wrapper
    File "/b/s/w/ir/tools/perf/core/stacktrace_unittest.py", line 71, in testBadBreakpadFileIgnored
    File "/b/s/w/ir/.swarming_module/lib/python2.7/tempfile.py", line 440, in __exit__
    File "/b/s/w/ir/.swarming_module/lib/python2.7/tempfile.py", line 431, in close
  OSError: [Errno 2] No such file or directory: '/b/s/w/ir/out/Debug/chrome.breakpaddr7O4P'

Retrying failed tests (attempt #1 of 3)...

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/067ae99a6de8b334fba0d2d3224b1f54ee2dc3c0

commit 067ae99a6de8b334fba0d2d3224b1f54ee2dc3c0
Author: Tsuyoshi Horo <horo@chromium.org>
Date: Tue Oct 30 07:56:24 2018

Disable TabStackTraceTest.testBadBreakpadFileIgnored

TBR=nednguyen@chromium.org

Bug:  893615 ,820282
Change-Id: Ie63980e2347a11c14855e40f75c8904420e9ffaa
Reviewed-on: https://chromium-review.googlesource.com/c/1306960
Reviewed-by: Tsuyoshi Horo <horo@chromium.org>
Commit-Queue: Tsuyoshi Horo <horo@chromium.org>
Cr-Commit-Position: refs/heads/master@{#603827}
[modify] https://crrev.com/067ae99a6de8b334fba0d2d3224b1f54ee2dc3c0/tools/perf/core/stacktrace_unittest.py

TabStackTraceTest.testCrashSymbols is flaky on Mac 12.12. I'll go ahead and disable.

Example log: https://chromium-swarm.appspot.com/task?id=4231dbe8abf2ea10&refresh=10&show_raw=1 ends with

Traceback (most recent call last):
  File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/testing/browser_test_case.py", line 39, in WrappedMethod
    method(self)
  File "/b/s/w/ir/tools/perf/core/stacktrace_unittest.py", line 30, in testCrashSymbols
    self.assertIn('CrashIntentionally', '\n'.join(c.exception.stack_trace))
AssertionError: 'CrashIntentionally' not found in "<really big wall of characters which I won't paste into crbug, doesn't appear to have any function names.>"

Looks semi-frequent based on flakiness dashboard: https://test-results.appspot.com/dashboards/flakiness_dashboard.html#showAllRuns=true&testType=telemetry_perf_unittests&builder=chromium.mac%3AMac10.12%20Tests&showExpectations=true

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/83cf4c4c27cd277e82976c6cfe66579714ba63cc

commit 83cf4c4c27cd277e82976c6cfe66579714ba63cc
Author: Max Morin <maxmorin@chromium.org>
Date: Fri Jan 04 15:40:29 2019

Disable TabStackTraceTest.testCrashSymbols on Mac.

Tbr: charliea
Bug: 820282
Change-Id: Ifa750d2c2a1b208b1c07acb1c473c220b7356a44
Reviewed-on: https://chromium-review.googlesource.com/c/1396146
Reviewed-by: Max Morin <maxmorin@chromium.org>
Commit-Queue: Max Morin <maxmorin@chromium.org>
Cr-Commit-Position: refs/heads/master@{#619957}
[modify] https://crrev.com/83cf4c4c27cd277e82976c6cfe66579714ba63cc/tools/perf/core/stacktrace_unittest.py

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/eb6da9e4fe2a277c3cf54988e2d02bfb6311429f

commit eb6da9e4fe2a277c3cf54988e2d02bfb6311429f
Author: Max Morin <maxmorin@chromium.org>
Date: Mon Jan 07 13:58:49 2019

Disable TabStackTraceTest.testCrashMinimalSymbols

Tbr: charliea
Bug: 820282
Change-Id: I7c22fd72aa659d2eb7f096d56faa030813af3f0d
Reviewed-on: https://chromium-review.googlesource.com/c/1397614
Reviewed-by: Max Morin <maxmorin@chromium.org>
Commit-Queue: Max Morin <maxmorin@chromium.org>
Cr-Commit-Position: refs/heads/master@{#620314}
[modify] https://crrev.com/eb6da9e4fe2a277c3cf54988e2d02bfb6311429f/tools/perf/core/stacktrace_unittest.py