New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 696824 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

"benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:news:qq" is flaky

Project Member Reported by chromium...@appspot.gserviceaccount.com, Feb 28 2017

Issue description

"benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:news:qq" is flaky.

This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label.

We have detected 3 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNydwsSBUZsYWtlImxiZW5jaG1hcmtzLnN5c3RlbV9oZWFsdGhfc21va2VfdGVzdC5TeXN0ZW1IZWFsdGhCZW5jaG1hcmtTbW9rZVRlc3Quc3lzdGVtX2hlYWx0aC5tZW1vcnlfZGVza3RvcC5sb2FkOm5ld3M6cXEM.

Flaky tests should be disabled within 30 minutes unless culprit CL is found and reverted. Please see more details here: https://sites.google.com/a/chromium.org/dev/developers/tree-sheriffs/sheriffing-bug-queues#triaging-auto-filed-flakiness-bugs
 

Comment 1 by yutak@chromium.org, Feb 28 2017

Looks like this test timeouts.

  *************** BROWSER STANDARD OUTPUT ***************
  
  *********** END OF BROWSER STANDARD OUTPUT ************
  ********************* BROWSER LOG *********************
  [3788:5808:0227/153932.736:ERROR:memory_mapped_file.cc(52)] Couldn't open e:\b\swarm_slave\w\irhg1e4r\out\Release_x64\chrome_200_percent.pak
  [3788:5808:0227/153932.736:ERROR:data_pack.cc(164)] Failed to mmap datapack
  [3788:5808:0227/153932.838:WARNING:chrome_browser_main_win.cc(442)] Command line too long for RegisterApplicationRestart
  [7336:2884:0227/153932.888:ERROR:gl_surface_egl.cc(693)] eglInitialize D3D11 failed with error EGL_NOT_INITIALIZED, trying next display type
  [3444:3436:0227/153933.048:ERROR:gl_surface_egl.cc(693)] eglInitialize D3D11 failed with error EGL_NOT_INITIALIZED, trying next display type
  [7336:2884:0227/153933.893:ERROR:gl_surface_egl.cc(693)] eglInitialize D3D9 failed with error EGL_NOT_INITIALIZED
  [7336:2884:0227/153933.893:ERROR:gl_initializer_win.cc(250)] GLSurfaceEGL::InitializeOneOff failed.
  [7336:2884:0227/153933.901:INFO:media_foundation_video_encode_accelerator_win.cc(329)] Windows versions earlier than 8 are not supported.
  [7336:2884:0227/153933.901:ERROR:gpu_child_thread.cc(325)] Exiting GPU process due to errors during initialization
  [3788:5276:0227/153933.902:ERROR:browser_gpu_channel_host_factory.cc(125)] Failed to create channel.
  [3788:5276:0227/153933.902:ERROR:browser_gpu_channel_host_factory.cc(125)] Failed to create channel.
  [3788:5276:0227/153933.902:ERROR:browser_gpu_channel_host_factory.cc(125)] Failed to create channel.
  [3788:5276:0227/153933.903:ERROR:browser_gpu_channel_host_factory.cc(125)] Failed to create channel.
  [3788:5276:0227/153933.903:ERROR:browser_gpu_channel_host_factory.cc(125)] Failed to create channel.
  [3444:3436:0227/153934.051:ERROR:gl_surface_egl.cc(693)] eglInitialize D3D9 failed with error EGL_NOT_INITIALIZED
  [3444:3436:0227/153934.051:ERROR:gl_initializer_win.cc(250)] GLSurfaceEGL::InitializeOneOff failed.
  [3444:3436:0227/153934.056:INFO:media_foundation_video_encode_accelerator_win.cc(329)] Windows versions earlier than 8 are not supported.
  [3444:3436:0227/153934.056:ERROR:gpu_child_thread.cc(325)] Exiting GPU process due to errors during initialization
  [3788:5808:0227/154004.047:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154005.075:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154016.111:INFO:CONSOLE(7)] "Uncaught RangeError: Offset is outside the bounds of the DataView", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (7)
  [3788:5808:0227/154016.133:INFO:CONSOLE(7)] "Uncaught RangeError: Offset is outside the bounds of the DataView", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (7)
  [3788:5808:0227/154039.278:INFO:CONSOLE(18)] "Uncaught InvalidCharacterError: Failed to execute 'btoa' on 'Window': The string to be encoded contains characters outside of the Latin1 range.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (18)
  [3788:5808:0227/154040.531:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154048.495:INFO:CONSOLE(7)] "Uncaught RangeError: Offset is outside the bounds of the DataView", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (7)
  [3788:5808:0227/154049.345:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154050.556:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154050.656:INFO:CONSOLE(7)] "Uncaught RangeError: Offset is outside the bounds of the DataView", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (7)
  [3788:5808:0227/154116.620:INFO:CONSOLE(18)] "Uncaught InvalidCharacterError: Failed to execute 'btoa' on 'Window': The string to be encoded contains characters outside of the Latin1 range.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (18)
  [3788:5808:0227/154119.593:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154120.488:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154121.081:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154121.784:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154121.910:INFO:CONSOLE(7)] "Uncaught RangeError: Offset is outside the bounds of the DataView", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (7)
  [3788:5808:0227/154123.302:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154124.087:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154147.072:INFO:CONSOLE(7)] "Uncaught RangeError: Offset is outside the bounds of the DataView", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (7)
  [3788:5808:0227/154149.479:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154150.085:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154150.680:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154151.162:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154152.761:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154153.624:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154157.004:INFO:CONSOLE(17)] "Uncaught TypeError: this is not a Date object.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (17)
  [3788:5808:0227/154157.078:INFO:CONSOLE(18)] "Uncaught InvalidCharacterError: Failed to execute 'btoa' on 'Window': The string to be encoded contains characters outside of the Latin1 range.", source: http://swa.gtimg.com/web/res/shumway/src/shumway-min.js?2 (18)
  
  ***************** END OF BROWSER LOG ******************
  Chrome version: 3026
  Error when deleting e:\b\swarm_slave\w\itvkdqcp\tmpjxespf, will try again at exit.
  Traceback (most recent call last):
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\platform\tracing_controller_backend.py", line 285, in CollectAgentTraceData
      os.remove(self._trace_log)
  WindowsError: [Error 32] The process cannot access the file because it is being used by another process: 'e:\\b\\swarm_slave\\w\\itvkdqcp\\tmpjxespf'
  Uploading e:\b\swarm_slave\w\itvkdqcp\tmpcvsnxo\chrome.log to gs://chrome-telemetry-output/log_facd02c5-2bd0-4ea9-81e3-3f9939d41ed7
  Uploading browser log to https://console.developers.google.com/m/cloudstorage/b/chrome-telemetry-output/o/log_facd02c5-2bd0-4ea9-81e3-3f9939d41ed7
  Successfully shut down browser cooperatively
  Try printing formatted exception: None None None
  
  Traceback (most recent call last):
    RunBenchmark at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\story_runner.py:364
      benchmark.ShouldTearDownStateAfterEachStorySetRun())
    Run at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\story_runner.py:243
      _RunStoryAndProcessErrorIfNeeded(story, results, state, test)
    _RunStoryAndProcessErrorIfNeeded at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\story_runner.py:88
      state.RunStory(results)
    traced_function at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py:75
      return func(*args, **kwargs)
    RunStory at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\page\shared_page_state.py:299
      self._current_page.Run(self)
    Run at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\page\__init__.py:112
      self.RunPageInteractions(action_runner)
    RunPageInteractions at e:\b\swarm_slave\w\irhg1e4r\tools\perf\page_sets\system_health\system_health_story.py:122
      self._Measure(action_runner)
    _Measure at e:\b\swarm_slave\w\irhg1e4r\tools\perf\page_sets\system_health\system_health_story.py:105
      action_runner.MeasureMemory(deterministic_mode=True)
    traced_function at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py:75
      return func(*args, **kwargs)
    MeasureMemory at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\actions\action_runner.py:158
      dump_id = self.tab.browser.DumpMemory()
    DumpMemory at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\browser\browser.py:323
      return self._browser_backend.DumpMemory(timeout)
    traced_function at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py:75
      return func(*args, **kwargs)
    DumpMemory at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\backends\chrome\chrome_browser_backend.py:275
      return self.devtools_client.DumpMemory(timeout)
    DumpMemory at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\devtools_client_backend.py:386
      return self._tracing_backend.DumpMemory(timeout)
    DumpMemory at e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\tracing_backend.py:208
      'request:\n' + traceback.format_exc())
  TracingTimeoutException: Exception raised while sending a Tracing.requestMemoryDump request:
  Traceback (most recent call last):
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\tracing_backend.py", line 204, in DumpMemory
      response = self._inspector_websocket.SyncRequest(request, timeout)
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_websocket.py", line 110, in SyncRequest
      res = self._Receive(timeout)
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_websocket.py", line 149, in _Receive
      data = self._socket.recv()
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\third_party\websocket-client\websocket\_core.py", line 293, in recv
      opcode, data = self.recv_data()
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\third_party\websocket-client\websocket\_core.py", line 310, in recv_data
      opcode, frame = self.recv_data_frame(control_frame)
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\third_party\websocket-client\websocket\_core.py", line 323, in recv_data_frame
      frame = self.recv_frame()
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\third_party\websocket-client\websocket\_core.py", line 357, in recv_frame
      return self.frame_buffer.recv_frame()
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\third_party\websocket-client\websocket\_abnf.py", line 336, in recv_frame
      self.recv_header()
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\third_party\websocket-client\websocket\_abnf.py", line 286, in recv_header
      header = self.recv_strict(2)
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\third_party\websocket-client\websocket\_abnf.py", line 371, in recv_strict
      bytes_ = self.recv(min(16384, shortage))
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\third_party\websocket-client\websocket\_core.py", line 427, in _recv
      return recv(self.sock, bufsize)
    File "e:\b\swarm_slave\w\irhg1e4r\third_party\catapult\telemetry\third_party\websocket-client\websocket\_socket.py", line 83, in recv
      raise WebSocketTimeoutException(message)
  WebSocketTimeoutException: timed out
  
  Locals:
    request : {'method': 'Tracing.requestMemoryDump', 'id': 0}
    timeout : 90
  
  Traceback (most recent call last):
    File "e:\b\swarm_slave\w\irhg1e4r\tools\perf\benchmarks\system_health_smoke_test.py", line 88, in RunTest
      msg='Failed: %s' % benchmark_class)
  AssertionError: Failed: <class 'benchmarks.system_health.DesktopMemorySystemHealth'>

Comment 2 by yutak@chromium.org, Feb 28 2017

Components: Speed>Telemetry Speed>Benchmarks

Comment 3 by yutak@chromium.org, Feb 28 2017

I'm disabling this test.

Comment 5 by yutak@chromium.org, Feb 28 2017

Cc: skyos...@chromium.org nednguyen@chromium.org
Owner: skyos...@chromium.org
Status: Available (was: Untriaged)
nednguyen, skyostil: Can you assign someone for this?
Project Member

Comment 6 by bugdroid1@chromium.org, Feb 28 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/41ca6f1ea85eaf0105769ba88dd51e0b1aab6f3d

commit 41ca6f1ea85eaf0105769ba88dd51e0b1aab6f3d
Author: yutak <yutak@chromium.org>
Date: Tue Feb 28 07:19:15 2017

Disable system_health.memory_desktop.load:news:qq.

BUG=696824
TBR=fsamuel@chromium.org,sergeyu@chromium.org,dvadym@chromium.org

Review-Url: https://codereview.chromium.org/2719323002
Cr-Commit-Position: refs/heads/master@{#453535}

[modify] https://crrev.com/41ca6f1ea85eaf0105769ba88dd51e0b1aab6f3d/tools/perf/benchmarks/system_health_smoke_test.py

Labels: -Sheriff-Chromium
Given the test was disabled, and an owner is assigned, I'm removing the sheriff label.
Cc: primiano@chromium.org perezju@chromium.org
Owner: kbr@chromium.org
Ken: based on the stack, it seems like this crash is related to GPU?

Cc'ed memory-infra folks because this crashes upon a dump command.

Comment 9 by kbr@chromium.org, Feb 28 2017

Cc: kbr@chromium.org
Owner: vmi...@chromium.org
It looks like the GPU process can't start (presumably because it's running in a VM), the page contains some Flash content which was converted to HTML5 via Shumway, that content requires WebGL, and WebGL isn't available. The Shumway content then throws JavaScript exceptions and the page fails to load properly.

I'd expect this to fail all the time if the benchmark runs on the same kind of VM all the time.

I'll be at a conference today, so reassigning to vmiura@ for more follow-up today. Could the Speed team consider running all benchmarks on physical hardware with real GPUs? Or at least this one? Running in a VM is not representative of how real users run the browser.

This is just a smoke test, the benchmark is also run elsewhere on real hardware. I think just disabling test as done in #6 should be fine.
Labels: -Pri-1 Pri-2
I'm not clear of this needs further action.  Lowering the priority given that the test was disabled and per #10 doesn't seem high priority.

What is the VM configuration and about:gpu information?
GPU info:
OS: win win7
  GPU device 0: VENDOR = 0x15ad, DEVICE = 0x405
  GPU Attributes:
    amd_switchable      : False
    basic_info_state    : 1
    context_info_state  : 0
    direct_rendering    : True
    driver_date         : 7-28-2011
    driver_vendor       : VMware, Inc.
    driver_version      : 7.14.1.1070
    dx_diagnostics_info_state: 0
    gl_extensions       : 
    gl_renderer         : 
    gl_reset_notification_strategy: 0
    gl_vendor           : 
    gl_version          : 
    gl_ws_extensions    : 
    gl_ws_vendor        : 
    gl_ws_version       : 
    in_process_gpu      : True
    initialization_time : 0
    jpeg_decode_accelerator_supported: False
    max_msaa_samples    : 
    optimus             : False
    passthrough_cmd_decoder: False
    pixel_shader_version: 
    process_crash_count : 0
    sandboxed           : False
    software_rendering  : False
    vertex_shader_version: 
    video_decode_accelerator_flags: 0
  Feature Status:
    2d_canvas           : unavailable_software
    flash_3d            : unavailable_software
    flash_stage3d       : unavailable_software
    flash_stage3d_baseline: unavailable_software
    gpu_compositing     : unavailable_software
    multiple_raster_threads: unavailable_off
    native_gpu_memory_buffers: disabled_software
    rasterization       : unavailable_software
    video_decode        : unavailable_software
    video_encode        : unavailable_software
    vpx_decode          : unavailable_software
    webgl               : unavailable_off
    webgl2              : unavailable_off
  Driver Bug Workarounds:
    clear_uniforms_before_first_program_use
    decode_encode_srgb_for_generatemipmap
    disable_direct_composition
    disable_discard_framebuffer
    disable_dxgi_zero_copy_video
    disable_framebuffer_cmaa
    exit_on_context_lost
    scalarize_vec_and_mat_constructor_args



(From https://chromium-swarm.appspot.com/task?id=349a5dfbbaef6810&refresh=10&show_raw=1)
Project Member

Comment 13 by sheriffbot@chromium.org, Apr 6 2018

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Status: Assigned (was: Untriaged)
This bug has an owner, thus, it's been triaged. Changing status to "assigned".
Components: Test>Telemetry
Components: -Speed>Telemetry

Sign in to add a comment