New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 659081 link

Starred by 1 user
Status: Fixed
Owner:
█ kbr@chromium.org
OOO until 2019-01-24
Closed: Dec 2016
Cc:
ynovikov@chromium.org
jbudorick@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: All
Pri: 2
Type: Bug

Blocked on:
issue 631845
Blocking:
issue 352807
issue 609252



Sign in to add a comment

"trace_test (with patch)" is flaky

Project Member Reported by chromium...@appspot.gserviceaccount.com, Oct 25 2016 
"trace_test (with patch)" is flaky.

This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label.

We have detected 3 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyIgsSBUZsYWtlIhd0cmFjZV90ZXN0ICh3aXRoIHBhdGNoKQw.



This flaky test/step was previously tracked in  issue 655303 .

Comment 1 by alancutter@chromium.org, Oct 26 2016

Components: Internals>GPU
Labels: OS-All

Comment 2 by foolip@chromium.org, Oct 26 2016 

4 recent failures on mac_chromium_rel_ng:
http://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/317350
http://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/320455
http://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/321230
http://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/321893

They're all different tests, but the failures are all of the variety "TimeoutException: Timed out while waiting 30s for IsJavaScriptExpressionTrue", e.g.:

[ RUN      ] trace_test.2DCanvasWebGL
(INFO) 2016-10-25 10:57:56,813 desktop_browser_backend.GetBrowserStartupArgs:250  Requested remote debugging port: 0
(INFO) 2016-10-25 10:57:56,813 desktop_browser_backend.Start:285  Starting Chrome ['/b/s/w/irbBQXSm/out/Release/Chromium.app/Contents/MacOS/Chromium', '--enable-experimental-canvas-features', '--js-flags=--expose-gc', '--enable-logging=stderr', '--enable-logging', '--enable-net-benchmarking', '--metrics-recording-only', '--no-default-browser-check', '--no-first-run', '--enable-gpu-benchmarking', '--disable-background-networking', '--proxy-server=socks://localhost:65516', '--ignore-certificate-errors', '--disable-component-extensions-with-background-pages', '--disable-default-apps', '--remote-debugging-port=0', '--enable-crash-reporter-for-testing', '--window-size=1280,1024', '--user-data-dir=/b/s/w/itLkcUqx/tmpGNcHDm', 'about:blank']
(INFO) 2016-10-25 10:57:57,119 desktop_browser_backend.HasBrowserFinishedLaunching:237  Discovered ephemeral port 65518
[27165:42755:1025/105757:ERROR:ssl_client_socket_impl.cc(1081)] handshake failed; returned -1, SSL error code 1, net_error -100
[27165:42755:1025/105757:ERROR:ssl_client_socket_impl.cc(1081)] handshake failed; returned -1, SSL error code 1, net_error -100
(INFO) 2016-10-25 10:57:57,738 browser._LogBrowserInfo:113  OS: mac elcapitan
(INFO) 2016-10-25 10:57:57,752 browser._LogBrowserInfo:117  Model: MacBookPro
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:120  GPU device 0: VENDOR = 0x1002 (ATI), DEVICE = 0x6821
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:120  GPU device 1: VENDOR = 0x8086 (Intel), DEVICE = 0xd26
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:122  GPU Attributes:
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    adapter_luid        : 0.0
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    amd_switchable      : True
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    basic_info_state    : 1
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    context_info_state  : 1
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    direct_rendering    : True
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    driver_date         : 
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    driver_vendor       : 
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    driver_version      : 10.14.73
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    encrypted_only      : False
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    gl_extensions       : GL_ARB_blend_func_extended GL_ARB_draw_buffers_blend GL_ARB_draw_indirect GL_ARB_ES2_compatibility GL_ARB_explicit_attrib_location GL_ARB_gpu_shader_fp64 GL_ARB_gpu_shader5 GL_ARB_instanced_arrays GL_ARB_internalformat_query GL_ARB_occlusion_query2 GL_ARB_sample_shading GL_ARB_sampler_objects GL_ARB_separate_shader_objects GL_ARB_shader_bit_encoding GL_ARB_shader_subroutine GL_ARB_shading_language_include GL_ARB_tessellation_shader GL_ARB_texture_buffer_object_rgb32 GL_ARB_texture_cube_map_array GL_ARB_texture_gather GL_ARB_texture_query_lod GL_ARB_texture_rgb10_a2ui GL_ARB_texture_storage GL_ARB_texture_swizzle GL_ARB_timer_query GL_ARB_transform_feedback2 GL_ARB_transform_feedback3 GL_ARB_vertex_attrib_64bit GL_ARB_vertex_type_2_10_10_10_rev GL_ARB_viewport_array GL_EXT_debug_label GL_EXT_debug_marker GL_EXT_framebuffer_multisample_blit_scaled GL_EXT_texture_compression_s3tc GL_EXT_texture_filter_anisotropic GL_EXT_texture_sRGB_decode GL_APPLE_client_storage GL_APPLE_container_object_shareable GL_APPLE_flush_render GL_APPLE_object_purgeable GL_APPLE_rgb_422 GL_APPLE_row_bytes GL_APPLE_texture_range GL_ATI_texture_mirror_once GL_NV_texture_barrier
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    gl_renderer         : Intel Iris Pro OpenGL Engine
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    gl_reset_notification_strategy: 0
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    gl_vendor           : Intel Inc.
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    gl_version          : 4.1 INTEL-10.14.73
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    gl_ws_extensions    : 
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    gl_ws_vendor        : 
(INFO) 2016-10-25 10:57:57,753 browser._LogBrowserInfo:124    gl_ws_version       : 
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    in_process_gpu      : False
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    initialization_time : 0.024911
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    jpeg_decode_accelerator_supported: False
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    lenovo_dcute        : False
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    max_framerate_denominator: 1
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    max_framerate_numerator: 30
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    max_msaa_samples    : 8
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    max_resolution_height: 2160
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    max_resolution_width: 4096
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    min_resolution_height: 16
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    min_resolution_width: 16
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    optimus             : False
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    pixel_shader_version: 4.10
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    process_crash_count : 0
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    profile             : 0
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    sandboxed           : True
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    software_rendering  : False
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    vertex_shader_version: 4.10
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:124    video_decode_accelerator_flags: 0
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:126  Feature Status:
(INFO) 2016-10-25 10:57:57,754 browser._LogBrowserInfo:128    2d_canvas           : enabled
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:128    flash_3d            : enabled
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:128    flash_stage3d       : enabled
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:128    flash_stage3d_baseline: enabled
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:128    gpu_compositing     : enabled
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:128    multiple_raster_threads: enabled_on
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:128    native_gpu_memory_buffers: enabled
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:128    rasterization       : enabled
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:128    video_decode        : enabled
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:128    video_encode        : enabled
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:128    vpx_decode          : enabled
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:128    webgl               : enabled
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:130  Driver Bug Workarounds:
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    add_and_true_to_loop_condition
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    adjust_src_dst_region_for_blitframebuffer
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    decode_encode_srgb_for_generatemipmap
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    disable_framebuffer_cmaa
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    disable_multimonitor_multisampling
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    disable_webgl_rgb_multisampling_usage
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    emulate_abs_int_function
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    get_frag_data_info_bug
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    init_one_cube_map_level_before_copyteximage
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    msaa_is_slow
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    pack_parameters_workaround_with_pack_buffer
(INFO) 2016-10-25 10:57:57,755 browser._LogBrowserInfo:132    rebind_transform_feedback_before_resume
(INFO) 2016-10-25 10:57:57,756 browser._LogBrowserInfo:132    regenerate_struct_names
(INFO) 2016-10-25 10:57:57,756 browser._LogBrowserInfo:132    reset_base_mipmap_level_before_texstorage
(INFO) 2016-10-25 10:57:57,756 browser._LogBrowserInfo:132    rewrite_texelfetchoffset_to_texelfetch
(INFO) 2016-10-25 10:57:57,756 browser._LogBrowserInfo:132    scalarize_vec_and_mat_constructor_args
(INFO) 2016-10-25 10:57:57,756 browser._LogBrowserInfo:132    set_zero_level_before_generating_mipmap
(INFO) 2016-10-25 10:57:57,756 browser._LogBrowserInfo:132    unfold_short_circuit_as_ternary_operation
(INFO) 2016-10-25 10:57:57,756 browser._LogBrowserInfo:132    unpack_alignment_workaround_with_unpack_buffer
(INFO) 2016-10-25 10:57:57,756 browser._LogBrowserInfo:132    unpack_image_height_workaround_with_unpack_buffer
(INFO) 2016-10-25 10:57:57,756 browser._LogBrowserInfo:132    use_intermediary_for_copy_texture_image
(INFO) 2016-10-25 10:57:57,756 browser._LogBrowserInfo:132    use_shadowed_tex_level_params
(INFO) 2016-10-25 10:57:57,756 browser._LogBrowserInfo:132    use_unused_standard_shared_blocks
(INFO) 2016-10-25 10:57:57,764 ts_proxy_server._IssueCommand:92  Issuing command to ts_proxy_server: set rtt 0
(INFO) 2016-10-25 10:57:57,874 ts_proxy_server._IssueCommand:92  Issuing command to ts_proxy_server: set inkbps 0
(INFO) 2016-10-25 10:57:57,875 ts_proxy_server._IssueCommand:92  Issuing command to ts_proxy_server: set outkbps 0
(INFO) 2016-10-25 10:57:57,876 cache_temperature.EnsurePageCacheTemperature:55  PageCacheTemperature: any
(INFO) 2016-10-25 10:57:58,038 chrome_tracing_agent._CreateTraceConfigFile:281  Trace config file string: {"trace_config": {"excluded_categories": ["*"], "included_categories": ["disabled-by-default-gpu.service", "disabled-by-default-gpu.device"], "record_mode": "record-as-much-as-possible"}}
(INFO) 2016-10-25 10:57:58,041 tracing_backend.StartTracing:133  Start Tracing Request: {'params': {'transferMode': 'ReturnAsStream', 'traceConfig': {'recordMode': 'recordAsMuchAsPossible', 'excludedCategories': ['*'], 'includedCategories': ['disabled-by-default-gpu.service', 'disabled-by-default-gpu.device']}}, 'method': 'Tracing.start'}
[27165:42755:1025/105807:ERROR:ssl_client_socket_impl.cc(1081)] handshake failed; returned -1, SSL error code 1, net_error -100
[27165:42755:1025/105807:ERROR:ssl_client_socket_impl.cc(1081)] handshake failed; returned -1, SSL error code 1, net_error -100
[27165:42755:1025/105807:ERROR:ssl_client_socket_impl.cc(1081)] handshake failed; returned -1, SSL error code 1, net_error -100
[27165:42755:1025/105807:ERROR:ssl_client_socket_impl.cc(1081)] handshake failed; returned -1, SSL error code 1, net_error -100
(INFO) 2016-10-25 10:58:33,489 browser.DumpStateUponFailure:350  *************** BROWSER STANDARD OUTPUT ***************
Can't get standard output with --show-stdout
(INFO) 2016-10-25 10:58:33,490 browser.DumpStateUponFailure:352  
(INFO) 2016-10-25 10:58:33,490 browser.DumpStateUponFailure:355  *********** END OF BROWSER STANDARD OUTPUT ************
(INFO) 2016-10-25 10:58:33,490 browser.DumpStateUponFailure:357  ********************* BROWSER LOG *********************
(INFO) 2016-10-25 10:58:33,490 browser.DumpStateUponFailure:359  No log file
(INFO) 2016-10-25 10:58:33,490 browser.DumpStateUponFailure:362  ***************** END OF BROWSER LOG ******************
(WARNING) 2016-10-25 10:58:33,490 shared_page_state.DumpStateUponFailure:152  Taking screenshots upon failures disabled.
Traceback (most recent call last):
  File "/b/s/w/irbBQXSm/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 86, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "/b/s/w/irbBQXSm/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/s/w/irbBQXSm/content/test/gpu/gpu_tests/gpu_test_base.py", line 111, in RunStory
    RunStoryWithRetries(GpuSharedPageState, self, results)
  File "/b/s/w/irbBQXSm/content/test/gpu/gpu_tests/gpu_test_base.py", line 72, in RunStoryWithRetries
    super(cls, shared_page_state).RunStory(results)
  File "/b/s/w/irbBQXSm/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/s/w/irbBQXSm/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 311, in RunStory
    self._current_page.Run(self)
  File "/b/s/w/irbBQXSm/third_party/catapult/telemetry/telemetry/page/__init__.py", line 105, in Run
    shared_state.page_test.RunNavigateSteps(self, current_tab)
  File "/b/s/w/irbBQXSm/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/b/s/w/irbBQXSm/third_party/catapult/telemetry/telemetry/page/legacy_page_test.py", line 195, in RunNavigateSteps
    page.RunNavigateSteps(action_runner)
  File "/b/s/w/irbBQXSm/content/test/gpu/page_sets/pixel_tests.py", line 32, in RunNavigateSteps
    'domAutomationController._finished', timeout_in_seconds=30)
  File "/b/s/w/irbBQXSm/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/b/s/w/irbBQXSm/third_party/catapult/telemetry/telemetry/internal/actions/action_runner.py", line 225, in WaitForJavaScriptCondition
    self._tab.WaitForJavaScriptExpression(condition, timeout_in_seconds)
  File "/b/s/w/irbBQXSm/third_party/catapult/telemetry/telemetry/internal/browser/web_contents.py", line 136, in WaitForJavaScriptExpression
    e.message + '\n' + debug_message)
TimeoutException: Timed out while waiting 30s for IsJavaScriptExpressionTrue.
Console output:


[  FAILED  ] trace_test.2DCanvasWebGL (36689 ms)

Comment 3 by foolip@chromium.org, Oct 26 2016 

Failures also all seem to have to do with 2d or 3d canvas.

Comment 4 by foolip@chromium.org, Oct 26 2016

Owner: kbr@chromium.org
Status: Assigned (was: Untriaged)
Different tests are failing every time, so there's nothing to disable AFAICT. kbr@, given that it seems to be canvas-related, could you take a look or route to someone who can?

Comment 5 by foolip@chromium.org, Oct 26 2016 

Failures keep trickling in, most recently trace_test.WebGLGreenTriangle.AA.NoAlpha, also on mac_chromium_rel_ng.

But there are failures on linux_chromium_rel_ng too, where it looks lots of things are timing out, an impressive display of purple and red:
https://build.chromium.org/p/tryserver.chromium.linux/builders/linux_chromium_rel_ng/builds/323282

Comment 6 by foolip@chromium.org, Oct 26 2016 

Interesting, android_optional_gpu_tests_rel seems to fail in another way:

Traceback (most recent call last):
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 86, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/swarm_slave/w/irYzpLRu/content/test/gpu/gpu_tests/gpu_test_base.py", line 111, in RunStory
    RunStoryWithRetries(GpuSharedPageState, self, results)
  File "/b/swarm_slave/w/irYzpLRu/content/test/gpu/gpu_tests/gpu_test_base.py", line 72, in RunStoryWithRetries
    super(cls, shared_page_state).RunStory(results)
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 310, in RunStory
    self._PreparePage()
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 284, in _PreparePage
    set([self._current_page.serving_dir]))
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/telemetry/telemetry/core/platform.py", line 410, in SetHTTPServerDirectories
    self.StartLocalServer(server)
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/telemetry/telemetry/core/platform.py", line 377, in StartLocalServer
    self._local_server_controller.StartServer(server)
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/telemetry/telemetry/core/local_server.py", line 164, in StartServer
    server.Start(self)
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/telemetry/telemetry/core/local_server.py", line 93, in Start
    local_server_controller.GetRemotePort(http_port)))
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/telemetry/telemetry/core/local_server.py", line 184, in CreateForwarder
    return self._platform_backend.forwarder_factory.Create(port_pair)
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/telemetry/telemetry/internal/forwarders/android_forwarder.py", line 25, in Create
    return AndroidForwarder(self._device, port_pair)
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/telemetry/telemetry/internal/forwarders/android_forwarder.py", line 60, in __init__
    [(port_pair.remote_port, port_pair.local_port)], self._device)
  File "/b/swarm_slave/w/irYzpLRu/third_party/catapult/devil/devil/android/forwarder.py", line 164, in Map
    formatted_output))
HostForwarderError: `/b/swarm_slave/w/irYzpLRu/third_party/catapult/devil/bin/deps/linux2/x86_64/forwarder_host --adb=/b/swarm_slave/w/irYzpLRu/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb --serial-id=00bd3cc774d69af4 --map 50046 50046` exited with 1:
[1021/035952:ERROR:host_forwarder_main.cc(477)] ERROR: Connection to device failed.
ERROR: Existing controllers:
ERROR: 44870:43159

Comment 7 by kbr@chromium.org, Oct 26 2016

Cc: jbudorick@chromium.org ynovikov@chromium.org
Components: -Internals>GPU Internals>GPU>Testing Infra>Client>Android Internals>Tracing
Labels: -Pri-1 Pri-2
jbudorick@ is working on stabilizing the Android bots -- I don't have the bug ID handy.

There aren't any trace_test failures on macOS in the last 200 runs on mac_chromium_rel_ng:
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng?numbuilds=200

or the Intel or AMD waterfall bots:
https://build.chromium.org/p/chromium.gpu/builders/Mac%2010.10%20Release%20%28Intel%29?numbuilds=200
https://build.chromium.org/p/chromium.gpu/builders/Mac%2010.10%20Retina%20Release%20%28AMD%29?numbuilds=200

The Linux tryservers look overloaded -- not just because of GPU jobs, but more generally.

Downgrading to P2. Let's see if this resurfaces.

Comment 8 by phoglund@chromium.org, Oct 31 2016

Labels: -Sheriff-Chromium
Project Member

Comment 9 by chromium...@appspot.gserviceaccount.com, Nov 1 2016 

Detected 3 new flakes for test/step "trace_test (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyIgsSBUZsYWtlIhd0cmFjZV90ZXN0ICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.

Comment 10 by kbr@chromium.org, Nov 4 2016

Blocking: 352807
These failures:

trace_test.IOSurface2DCanvas :
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/326227
trace_test.OffscreenCanvasWebGLGreenBox :
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/326206
trace_test.WebGLGreenTriangle.AA.Alpha :
https://build.chromium.org/p/tryserver.chromium.linux/builders/linux_chromium_rel_ng/builds/328198

all time out waiting for the test to complete:

Traceback (most recent call last):
  File "/b/s/w/irE1SVwA/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 87, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "/b/s/w/irE1SVwA/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/s/w/irE1SVwA/content/test/gpu/gpu_tests/gpu_test_base.py", line 111, in RunStory
    RunStoryWithRetries(GpuSharedPageState, self, results)
  File "/b/s/w/irE1SVwA/content/test/gpu/gpu_tests/gpu_test_base.py", line 72, in RunStoryWithRetries
    super(cls, shared_page_state).RunStory(results)
  File "/b/s/w/irE1SVwA/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/s/w/irE1SVwA/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 299, in RunStory
    self._current_page.Run(self)
  File "/b/s/w/irE1SVwA/third_party/catapult/telemetry/telemetry/page/__init__.py", line 105, in Run
    shared_state.page_test.RunNavigateSteps(self, current_tab)
  File "/b/s/w/irE1SVwA/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/b/s/w/irE1SVwA/third_party/catapult/telemetry/telemetry/page/legacy_page_test.py", line 195, in RunNavigateSteps
    page.RunNavigateSteps(action_runner)
  File "/b/s/w/irE1SVwA/content/test/gpu/page_sets/pixel_tests.py", line 32, in RunNavigateSteps
    'domAutomationController._finished', timeout_in_seconds=30)
  File "/b/s/w/irE1SVwA/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/b/s/w/irE1SVwA/third_party/catapult/telemetry/telemetry/internal/actions/action_runner.py", line 240, in WaitForJavaScriptCondition
    self._tab.WaitForJavaScriptExpression(condition, timeout_in_seconds)
  File "/b/s/w/irE1SVwA/third_party/catapult/telemetry/telemetry/internal/browser/web_contents.py", line 137, in WaitForJavaScriptExpression
    e.message + '\n' + debug_message)
TimeoutException: Timed out while waiting 30s for IsJavaScriptExpressionTrue.


I don't know what's going on here. There are no logs indicating that something deeper failed. I still need to port these tests to the new gpu_integration_test harness, and maybe that port will clear up some of these lingering problems.
Project Member

Comment 11 by chromium...@appspot.gserviceaccount.com, Nov 5 2016 

Detected 3 new flakes for test/step "trace_test (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyIgsSBUZsYWtlIhd0cmFjZV90ZXN0ICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.

Comment 12 by kbr@chromium.org, Nov 5 2016

Blockedon: 631845
Those last 3 flakes were capacity issues on the Windows tryservers. This will be alleviated with the new bots coming online in Issue 631845.
Project Member

Comment 13 by bugdroid1@chromium.org, Dec 30 2016 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/a26950fe56633698f770410238c2d0e8624015ce

commit a26950fe56633698f770410238c2d0e8624015ce
Author: kbr <kbr@chromium.org>
Date: Fri Dec 30 09:23:11 2016

Port trace_test to the new gpu_integration_test harness.

This removes the last reference to the old pixel_tests story_set.
Remove it.

BUG= 352807 ,  659081 
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.linux:linux_optional_gpu_tests_rel;master.tryserver.chromium.mac:mac_optional_gpu_tests_rel;master.tryserver.chromium.win:win_optional_gpu_tests_rel;master.tryserver.chromium.android:android_optional_gpu_tests_rel
TBR=zmo@chromium.org

Review-Url: https://codereview.chromium.org/2604153005
Cr-Commit-Position: refs/heads/master@{#441023}

[modify] https://crrev.com/a26950fe56633698f770410238c2d0e8624015ce/content/test/gpu/generate_buildbot_json.py
[add] https://crrev.com/a26950fe56633698f770410238c2d0e8624015ce/content/test/gpu/gpu_tests/trace_integration_test.py
[delete] https://crrev.com/795de01a5f04ab858c07e0af0ba56370eaae0aab/content/test/gpu/gpu_tests/trace_test.py
[modify] https://crrev.com/a26950fe56633698f770410238c2d0e8624015ce/content/test/gpu/gpu_tests/trace_test_expectations.py
[modify] https://crrev.com/a26950fe56633698f770410238c2d0e8624015ce/content/test/gpu/page_sets/__init__.py
[delete] https://crrev.com/795de01a5f04ab858c07e0af0ba56370eaae0aab/content/test/gpu/page_sets/pixel_tests.py
[modify] https://crrev.com/a26950fe56633698f770410238c2d0e8624015ce/testing/buildbot/chromium.gpu.fyi.json
[modify] https://crrev.com/a26950fe56633698f770410238c2d0e8624015ce/testing/buildbot/chromium.gpu.json

Comment 14 by kbr@chromium.org, Dec 30 2016

Blocking: 609252
Status: Fixed (was: Assigned)
The last reported flake was 4 days ago:
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/360139

and was a random GPU process hang ( Issue 609252 ) for which we didn't get a symbolized stack trace.

trace_test has now been ported to the new harness, and marking individual tests flaky should work a lot better. Closing this as fixed.
►

Sign in to add a comment