New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 844212 link

Starred by 2 users

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Windows
Pri: 1
Type: Bug



Sign in to add a comment

thread_times.tough_compositor_cases fails to run on Windows

Project Member Reported by sunn...@chromium.org, May 17 2018

Issue description

Ehsan, assigned to you because Ned suggested this might be related to your recent changes.

C:\src\chromium\src$ python tools\perf\run_benchmark run --browser=release --story-filter=beqojupo --reset-results thread_times.tough_compositor_cases
WARNING:root:Unable to import numpy due to: No module named numpy
WARNING:root:Unable to import numpy due to: No module named numpy
WARNING:root:Failed to import devil.android.forwarder: No module named fcntl
(WARNING) 2018-05-17 14:40:47,973 desktop_browser_finder.FindAllAvailableBrowsers:267  Chrome build location for win_AMD64 not found. Browser will be run without Flash.
(WARNING) 2018-05-17 14:40:47,982 desktop_browser_finder.FindAllAvailableBrowsers:267  Chrome build location for win_AMD64 not found. Browser will be run without Flash.
(WARNING) 2018-05-17 14:40:54,539 desktop_browser_finder.FindAllAvailableBrowsers:267  Chrome build location for win_AMD64 not found. Browser will be run without Flash.
[ RUN      ] thread_times.tough_compositor_cases/http://jsbin.com/beqojupo/1/quiet?JS_FULL_SCREEN_INVALIDATION
(WARNING) 2018-05-17 14:41:43,746 model._CreateImporters:274  No importer found for TraceDataPart("telemetry")
C:\src\chromium\src\third_party\catapult\telemetry\telemetry\internal\image_processing\_bitmap.py:152: UserWarning: Using pure python png decoder, which could be very slow. To speed up, consider installing numpy & cv2 (OpenCV).
  'Using pure python png decoder, which could be very slow. To speed up, '
(WARNING) 2018-05-17 14:41:55,335 screenshot.TryCaptureScreenShot:49  Exception when trying to capture screenshot: MemoryError()
Traceback (most recent call last):
  File "C:\src\chromium\src\third_party\catapult\telemetry\telemetry\internal\story_runner.py", line 125, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "C:\src\chromium\src\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "C:\src\chromium\src\third_party\catapult\telemetry\telemetry\page\shared_page_state.py", line 310, in RunStory
    self._current_page, self._current_tab, results)
  File "C:\src\chromium\src\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "C:\src\chromium\src\tools\perf\measurements\thread_times.py", line 43, in ValidateAndMeasurePage
    self._timeline_controller.Stop(tab, results)
  File "C:\src\chromium\src\tools\perf\measurements\timeline_controller.py", line 70, in Stop
    self._model = TimelineModel(timeline_data)
  File "C:\src\chromium\src\third_party\catapult\telemetry\telemetry\timeline\model.py", line 76, in __init__
    self.ImportTraces(trace_data, shift_world_to_zero=shift_world_to_zero)
  File "C:\src\chromium\src\third_party\catapult\telemetry\telemetry\timeline\model.py", line 156, in ImportTraces
    importer.ImportEvents()
  File "C:\src\chromium\src\third_party\catapult\telemetry\telemetry\timeline\trace_event_importer.py", line 241, in ImportEvents
    self._ProcessCompleteEvent(event)
  File "C:\src\chromium\src\third_party\catapult\telemetry\telemetry\timeline\trace_event_importer.py", line 155, in _ProcessCompleteEvent
    event['args'])
  File "C:\src\chromium\src\third_party\catapult\telemetry\telemetry\timeline\thread.py", line 158, in PushCompleteSlice
    self.PushSlice(new_slice)
  File "C:\src\chromium\src\third_party\catapult\telemetry\telemetry\timeline\thread.py", line 170, in PushSlice
    self._newly_added_slices.append(new_slice)
MemoryError
 
[  FAILED  ] thread_times.tough_compositor_cases/http://jsbin.com/beqojupo/1/quiet?JS_FULL_SCREEN_INVALIDATION (61033 ms)
(CRITICAL) 2018-05-17 14:41:56,579 story_runner.RunBenchmark:369  Benchmark execution interrupted by a fatal exception.
 
Traceback (most recent call last):
  RunBenchmark at C:\src\chromium\src\third_party\catapult\telemetry\telemetry\internal\story_runner.py:362
    expectations=expectations, max_num_values=benchmark.MAX_NUM_VALUES)
  Run at C:\src\chromium\src\third_party\catapult\telemetry\telemetry\internal\story_runner.py:265
    results.PopulateHistogramSet()
  PopulateHistogramSet at C:\src\chromium\src\third_party\catapult\telemetry\telemetry\internal\results\page_test_results.py:280
    vinn_result = convert_chart_json.ConvertChartJson(chart_json_path)
  ConvertChartJson at C:\src\chromium\src\third_party\catapult\tracing\tracing\value\convert_chart_json.py:24
    js_args=[os.path.abspath(chart_json)])
  RunFile at C:\src\chromium\src\third_party\catapult\third_party\vinn\vinn\_vinn.py:190
    return _RunFileWithD8(temp_boostrap_file, js_args, v8_args, stdout, stdin)
  _RunFileWithD8 at C:\src\chromium\src\third_party\catapult\third_party\vinn\vinn\_vinn.py:249
    out, _ = sp.communicate()
  communicate at C:\src\depot_tools\win_tools-2_7_6_bin\python\bin\lib\subprocess.py:798
    return self._communicate(input)
  _communicate at C:\src\depot_tools\win_tools-2_7_6_bin\python\bin\lib\subprocess.py:1024
    stdout_thread.start()
  start at C:\src\depot_tools\win_tools-2_7_6_bin\python\bin\lib\threading.py:745
    _start_new_thread(self.__bootstrap, ())
error: can't start new thread
 
Locals:
  No locals!
 
(WARNING) 2018-05-17 14:41:56,601 memory_debug.LogHostMemoryUsage:50  psutil 1.1.3 too old, upgrade to version 2.0 or higher for memory usage information.
[  PASSED  ] 0 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ]  http://jsbin.com/beqojupo/1/quiet?JS_FULL_SCREEN_INVALIDATION
 
1 FAILED TEST
 
 
Traceback (most recent call last):
  <module> at C:\src\chromium\src\tools\perf\run_benchmark:27
    sys.exit(main())
  main at C:\src\chromium\src\tools\perf\run_benchmark:23
    return benchmark_runner.main(config, [trybot_command.Trybot])
  main at C:\src\chromium\src\third_party\catapult\telemetry\telemetry\benchmark_runner.py:439
    return command_instance.Run(options)
  Run at C:\src\chromium\src\third_party\catapult\telemetry\telemetry\benchmark_runner.py:309
    return min(255, b.Run(args))
  Run at C:\src\chromium\src\third_party\catapult\telemetry\telemetry\benchmark.py:100
    return story_runner.RunBenchmark(self, finder_options)
  RunBenchmark at C:\src\chromium\src\third_party\catapult\telemetry\telemetry\internal\story_runner.py:395
    results.PrintSummary()
  PrintSummary at C:\src\chromium\src\third_party\catapult\telemetry\telemetry\internal\results\page_test_results.py:553
    output_formatter.Format(self)
  Format at C:\src\chromium\src\third_party\catapult\telemetry\telemetry\internal\results\html_output_formatter.py:28
    histograms, self._output_stream, self._reset_results)
  VulcanizeAndRenderHistogramsViewer at C:\src\chromium\src\third_party\catapult\tracing\tracing_build\vulcanize_histograms_viewer.py:27
    VulcanizeHistogramsViewer())
  VulcanizeHistogramsViewer at C:\src\chromium\src\third_party\catapult\tracing\tracing_build\vulcanize_histograms_viewer.py:20
    return generate.GenerateStandaloneHTMLAsString(load_sequence)
  GenerateStandaloneHTMLAsString at C:\src\chromium\src\third_party\catapult\common\py_vulcanize\py_vulcanize\generate.py:197
    return f.getvalue()
  getvalue at C:\src\depot_tools\win_tools-2_7_6_bin\python\bin\lib\StringIO.py:271
    self.buf += ''.join(self.buflist)
MemoryError
 
Locals:
  No locals!
 
C:\src\chromium\src$ where python
C:\src\depot_tools\python.bat
C:\python_27_amd64\files\python.exe

 
Cc: benjhayden@chromium.org chiniforooshan@chromium.org
Ehsan: I suspect this has to do with your work recently?
Oddly, running the benchmark with a debug build works :/
Weird! So you are running out of memory. This does not look like something that can be caused by crrev.com/c/1057436. How much memory do you have on the machine that runs the benchmark?
128 GB of which only 27 GB is committed. However, the python in depot_tools is 32 bit so who knows?
Ben: I wonder whether this also have to do with d8 version on Windows
Why do you suspect d8? All those stacktraces are python OOMs, right?
Why isn't a 64-bit python being used?
Do you want to try using my heap profiler? https://chromium-review.googlesource.com/c/catapult/+/754453
depot_tools python is 32-bit and it needs to be first in PATH AFAIK

Sign in to add a comment