New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 852485 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
Last visit > 30 days ago
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

"telemetry.web_perf.timeline_based_page_test_unittest.TimelineBasedMeasurementTest.testTraceCaptureUponFailure" is flaky

Project Member Reported by chromium...@appspot.gserviceaccount.com, Jun 13 2018

Issue description

"telemetry.web_perf.timeline_based_page_test_unittest.TimelineBasedMeasurementTest.testTraceCaptureUponFailure" is flaky.

This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label.

We have detected 3 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyeAsSBUZsYWtlIm10ZWxlbWV0cnkud2ViX3BlcmYudGltZWxpbmVfYmFzZWRfcGFnZV90ZXN0X3VuaXR0ZXN0LlRpbWVsaW5lQmFzZWRNZWFzdXJlbWVudFRlc3QudGVzdFRyYWNlQ2FwdHVyZVVwb25GYWlsdXJlDA.

Flaky tests should be disabled within 30 minutes unless culprit CL is found and reverted. Please see more details here: https://sites.google.com/a/chromium.org/dev/developers/tree-sheriffs/sheriffing-bug-queues#triaging-auto-filed-flakiness-bugs
 
Error Log:

[296/296] telemetry.web_perf.timeline_based_page_test_unittest.TimelineBasedMeasurementTest.testTraceCaptureUponFailure failed unexpectedly 8.4161s:
  condition '<lambda>' met
  condition '<lambda>' met
  Chrome build location for mac_x86_64 not found. Browser will be run without Flash.
  Tsproxy commandline: ['/b/s/w/ir/.swarming_module_cache/vpython/fe1f6b/bin/python', '/b/s/w/ir/third_party/catapult/telemetry/third_party/tsproxy/tsproxy.py', '--port=0', '--desthost=127.0.0.1']
  TsProxy port: 56408
  DoNothingForwarder started between 127.0.0.1:56408 and 56408
  Starting Chrome ['../../out/Release/Chromium.app/Contents/MacOS/Chromium', '--enable-net-benchmarking', '--metrics-recording-only', '--no-default-browser-check', '--no-first-run', '--enable-gpu-benchmarking', '--deny-permission-prompts', '--autoplay-policy=no-user-gesture-required', '--disable-background-networking', '--disable-component-extensions-with-background-pages', '--disable-default-apps', '--disable-search-geolocation-disclosure', '--proxy-server=socks://localhost:56408', '--ignore-certificate-errors-spki-list=PhrPvGIaAMmd29hj8BCZOq096yj7uMpRNHpn5PDxI6I=', '--remote-debugging-port=0', '--enable-crash-reporter-for-testing', '--disable-component-update', '--window-size=1280,1024', '--user-data-dir=/b/s/w/itx_d0GW/tmp05bRKA', 'about:blank']
  DoNothingForwarder started between 127.0.0.1:56409 and 56409
  Got devtools config: ws://127.0.0.1:56409/devtools/browser/32e48dd9-669d-4470-8003-4a6549d5e569
  Browser started (pid=8719).
  OS: mac highsierra
  Detailed OS version: 10.13.5 17F77
  Model: VMware 7.1
  Browser command line: ../../out/Release/Chromium.app/Contents/MacOS/Chromium --enable-net-benchmarking --metrics-recording-only --no-default-browser-check --no-first-run --enable-gpu-benchmarking --deny-permission-prompts --autoplay-policy=no-user-gesture-required --disable-background-networking --disable-component-extensions-with-background-pages --disable-default-apps --disable-search-geolocation-disclosure --proxy-server=socks://localhost:56408 --ignore-certificate-errors-spki-list=PhrPvGIaAMmd29hj8BCZOq096yj7uMpRNHpn5PDxI6I= --remote-debugging-port=0 --enable-crash-reporter-for-testing --disable-component-update --window-size=1280,1024 --user-data-dir=/b/s/w/itx_d0GW/tmp05bRKA --flag-switches-begin --flag-switches-end about:blank
  GPU device 0: VENDOR = 0x15ad (Apple Inc.), DEVICE = 0x405 (Apple Software Renderer)
  GPU Attributes:
    amd_switchable      : False
    can_support_threaded_texture_mailbox: False
    direct_composition  : False
    direct_rendering    : True
    gl_extensions       : GL_ARB_blend_func_extended GL_ARB_draw_buffers_blend GL_ARB_draw_indirect GL_ARB_ES2_compatibility GL_ARB_explicit_attrib_location GL_ARB_gpu_shader_fp64 GL_ARB_gpu_shader5 GL_ARB_instanced_arrays GL_ARB_internalformat_query GL_ARB_occlusion_query2 GL_ARB_sample_shading GL_ARB_sampler_objects GL_ARB_separate_shader_objects GL_ARB_shader_bit_encoding GL_ARB_shader_subroutine GL_ARB_shading_language_include GL_ARB_tessellation_shader GL_ARB_texture_buffer_object_rgb32 GL_ARB_texture_cube_map_array GL_ARB_texture_gather GL_ARB_texture_query_lod GL_ARB_texture_rgb10_a2ui GL_ARB_texture_storage GL_ARB_texture_swizzle GL_ARB_timer_query GL_ARB_transform_feedback2 GL_ARB_transform_feedback3 GL_ARB_vertex_attrib_64bit GL_ARB_vertex_type_2_10_10_10_rev GL_ARB_viewport_array GL_EXT_debug_label GL_EXT_debug_marker GL_EXT_depth_bounds_test GL_EXT_framebuffer_multisample_blit_scaled GL_EXT_texture_compression_s3tc GL_EXT_texture_filter_anisotropic GL_EXT_texture_mirror_clamp GL_EXT_texture_sRGB_decode GL_APPLE_client_storage GL_APPLE_container_object_shareable GL_APPLE_flush_render GL_APPLE_rgb_422 GL_APPLE_row_bytes GL_APPLE_texture_range GL_ATI_texture_mirror_once GL_NV_texture_barrier
    gl_renderer         : Apple Software Renderer
    gl_reset_notification_strategy: 0
    gl_vendor           : Apple Inc.
    gl_version          : 4.1 APPLE-16.5.10
    gl_ws_extensions    : 
    gl_ws_vendor        : 
    gl_ws_version       : 
    in_process_gpu      : False
    initialization_time : 0.089243
    jpeg_decode_accelerator_supported: False
    max_msaa_samples    : 16
    oop_rasterization_supported: True
    optimus             : False
    passthrough_cmd_decoder: False
    pixel_shader_version: 4.10
    process_crash_count : 0
    sandboxed           : True
    software_rendering  : False
    supports_overlays   : False
    vertex_shader_version: 4.10
    video_decode_accelerator_flags: 0
  Feature Status:
    2d_canvas           : enabled
    flash_3d            : enabled
    flash_stage3d       : enabled
    flash_stage3d_baseline: enabled
    gpu_compositing     : enabled
    multiple_raster_threads: enabled_on
    native_gpu_memory_buffers: enabled
    oop_rasterization   : unavailable_off
    protected_video_decode: unavailable_off
    rasterization       : unavailable_off
    skia_deferred_display_list: disabled_off
    skia_renderer       : disabled_off
    surface_synchronization: enabled_on
    video_decode        : enabled
    viz_display_compositor: disabled_off
    webgl               : enabled
    webgl2              : enabled
  Driver Bug Workarounds:
    adjust_src_dst_region_for_blitframebuffer
    decode_encode_srgb_for_generatemipmap
    disable_2d_canvas_auto_flush
    disable_framebuffer_cmaa
    get_frag_data_info_bug
    pack_parameters_workaround_with_pack_buffer
    regenerate_struct_names
    remove_invariant_and_centroid_for_essl3
    scalarize_vec_and_mat_constructor_args
    set_zero_level_before_generating_mipmap
    unfold_short_circuit_as_ternary_operation
    unpack_alignment_workaround_with_unpack_buffer
    use_intermediary_for_copy_texture_image
    use_unused_standard_shared_blocks
  Issuing command to ts_proxy_server: set rtt 0
  Issuing command to ts_proxy_server: set inkbps 0
  Issuing command to ts_proxy_server: set outkbps 0
  PageCacheTemperature: any
  Handleable error. Will try to restart shared state
  Traceback (most recent call last):
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 126, in _RunStoryAndProcessErrorIfNeeded
      state.RunStory(results)
    File "/b/s/w/ir/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
      return func(*args, **kwargs)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 310, in RunStory
      self._current_page.Run(self)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/page/__init__.py", line 99, in Run
      self.RunPageInteractions(action_runner)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/web_perf/timeline_based_page_test_unittest.py", line 61, in RunPageInteractions
      action_runner.TapElement('#does-not-exist')
    File "/b/s/w/ir/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
      return func(*args, **kwargs)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/actions/action_runner.py", line 305, in TapElement
      selector=selector, text=text, element_function=element_function))
    File "/b/s/w/ir/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
      return func(*args, **kwargs)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/actions/action_runner.py", line 62, in _RunAction
      action.RunAction(self._tab)
    File "/b/s/w/ir/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
      return func(*args, **kwargs)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/actions/tap.py", line 77, in RunAction
      element_function=self.element_function)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/actions/page_action.py", line 130, in EvaluateCallbackWithElement
      return tab.EvaluateJavaScript(code)
    File "/b/s/w/ir/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
      return func(*args, **kwargs)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/browser/web_contents.py", line 215, in EvaluateJavaScript
      return self._inspector_backend.EvaluateJavaScript(*args, **kwargs)
    File "/b/s/w/ir/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
      return func(*args, **kwargs)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/inspector_backend.py", line 252, in EvaluateJavaScript
      return self._EvaluateJavaScript(expression, context_id, timeout)
    File "/b/s/w/ir/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
      return func(*args, **kwargs)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/inspector_backend.py", line 38, in Inner
      return func(inspector_backend, *args, **kwargs)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/inspector_backend.py", line 519, in _EvaluateJavaScript
      return self._runtime.Evaluate(expression, context_id, timeout)
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/inspector_runtime.py", line 53, in Evaluate
      description=details.get('exception', {}).get('description'))
  EvaluateException: UncaughtError:
  Error: Cannot find element: using selector "#does-not-exist"
      at callback (<anonymous>:7:19)
      at <anonymous>:17:16
      at <anonymous>:18:9
Components: Speed>Telemetry
Labels: -Sheriff-Chromium
Owner: eakuefner@chromium.org
Status: Assigned (was: Untriaged)
Assigning to eakuefner@ as an OWNER, please investigate.
Owner: nednguyen@chromium.org
Reassigning to Ned for triage. 
Project Member

Comment 4 by chromium...@appspot.gserviceaccount.com, Jun 15 2018

Labels: Sheriff-Chromium
Detected 3 new flakes for test/step "telemetry.web_perf.timeline_based_page_test_unittest.TimelineBasedMeasurementTest.testTraceCaptureUponFailure". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyeAsSBUZsYWtlIm10ZWxlbWV0cnkud2ViX3BlcmYudGltZWxpbmVfYmFzZWRfcGFnZV90ZXN0X3VuaXR0ZXN0LlRpbWVsaW5lQmFzZWRNZWFzdXJlbWVudFRlc3QudGVzdFRyYWNlQ2FwdHVyZVVwb25GYWlsdXJlDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
Labels: -Sheriff-Chromium
Removing from sheriff queue since it's got an owner assigned.
Project Member

Comment 6 by chromium...@appspot.gserviceaccount.com, Jun 17 2018

Labels: Sheriff-Chromium
Detected 3 new flakes for test/step "telemetry.web_perf.timeline_based_page_test_unittest.TimelineBasedMeasurementTest.testTraceCaptureUponFailure". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyeAsSBUZsYWtlIm10ZWxlbWV0cnkud2ViX3BlcmYudGltZWxpbmVfYmFzZWRfcGFnZV90ZXN0X3VuaXR0ZXN0LlRpbWVsaW5lQmFzZWRNZWFzdXJlbWVudFRlc3QudGVzdFRyYWNlQ2FwdHVyZVVwb25GYWlsdXJlDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Comment 7 by ortuno@chromium.org, Jun 18 2018

Labels: -Sheriff-Chromium

Comment 8 by benhenry@google.com, Jan 16 (6 days ago)

Components: Test>Telemetry

Comment 9 by benhenry@google.com, Jan 16 (6 days ago)

Components: -Speed>Telemetry

Sign in to add a comment