New issue
Advanced search Search tips

Issue 917389 link

Starred by 2 users

Issue metadata

Status: Untriaged
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Timeouts in telemetry unit_tests causes INVALID_TEST_RESULTS

Project Member Reported by erikc...@chromium.org, Dec 21

Issue description

Example task: https://chromium-swarm.appspot.com/task?id=41e89f539f21f710&refresh=10&show_raw=1

From build: https://ci.chromium.org/p/chromium/builders/luci.chromium.try/chromeos-amd64-generic-rel/157256

The task ran for 20 minutes and then ended with the status TIMED_OUT. The logs seem to imply that all the tests ran, but maybe there were some bugs in writing the output.
"""
Retrying failed tests (attempt #1 of 3)...

[1/1] telemetry.core.tracing_controller_unittest.StartupTracingTest.testRestartBrowserWhileTracing failed unexpectedly 0.0156s:
  Chose browser: PossibleCrOSBrowser(browser_type=cros-chrome)
  Traceback (most recent call last):
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/decorators.py", line 219, in wrapper
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/core/tracing_controller_unittest.py", line 184, in testRestartBrowserWhileTracing
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/core/tracing_controller.py", line 43, in StartTracing
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py", line 102, in StartTracing
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py", line 190, in StartAgentTracing
    File "/b/s/w/ir/.swarming_module/lib/python2.7/tempfile.py", line 475, in NamedTemporaryFile
    File "/b/s/w/ir/.swarming_module/lib/python2.7/tempfile.py", line 244, in _mkstemp_inner
  OSError: [Errno 2] No such file or directory: '/b/s/w/itNOPT6p/tmpoc3MkC'

Retrying failed tests (attempt #2 of 3)...

[1/1] telemetry.core.tracing_controller_unittest.StartupTracingTest.testRestartBrowserWhileTracing failed unexpectedly 0.0111s:
  Chose browser: PossibleCrOSBrowser(browser_type=cros-chrome)
  Traceback (most recent call last):
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/decorators.py", line 219, in wrapper
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/core/tracing_controller_unittest.py", line 184, in testRestartBrowserWhileTracing
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/core/tracing_controller.py", line 43, in StartTracing
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py", line 102, in StartTracing
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py", line 190, in StartAgentTracing
    File "/b/s/w/ir/.swarming_module/lib/python2.7/tempfile.py", line 475, in NamedTemporaryFile
    File "/b/s/w/ir/.swarming_module/lib/python2.7/tempfile.py", line 244, in _mkstemp_inner
  OSError: [Errno 2] No such file or directory: '/b/s/w/itNOPT6p/tmpDBcJT0'

Retrying failed tests (attempt #3 of 3)...

[1/1] telemetry.core.tracing_controller_unittest.StartupTracingTest.testRestartBrowserWhileTracing failed unexpectedly 0.0103s:
  Chose browser: PossibleCrOSBrowser(browser_type=cros-chrome)
  Traceback (most recent call last):
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/decorators.py", line 219, in wrapper
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/core/tracing_controller_unittest.py", line 184, in testRestartBrowserWhileTracing
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/core/tracing_controller.py", line 43, in StartTracing
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py", line 102, in StartTracing
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py", line 190, in StartAgentTracing
    File "/b/s/w/ir/.swarming_module/lib/python2.7/tempfile.py", line 475, in NamedTemporaryFile
    File "/b/s/w/ir/.swarming_module/lib/python2.7/tempfile.py", line 244, in _mkstemp_inner
  OSError: [Errno 2] No such file or directory: '/b/s/w/itNOPT6p/tmpKPXlx9'

84 tests passed in 997.3s, 11 skipped, 1 failure.
(INFO) 2018-12-21 00:27:53,935 pid=12416  exception_formatter.PrintFormattedException:19  Try printing formatted exception: <type 'exceptions.IOError'> [Errno 2] No such file or directory: '/b/s/w/ioQFW53M/output.json' <traceback object at 0x7fdedb680758>

Traceback (most recent call last):
  <module> at /b/s/w/ir/third_party/catapult/telemetry/telemetry/testing/run_tests.py:312
    None
  main at /b/s/w/ir/third_party/catapult/telemetry/telemetry/testing/run_tests.py:129
    None
  Run at /b/s/w/ir/third_party/catapult/telemetry/telemetry/testing/run_tests.py:204
    None
  run at /b/s/w/ir/third_party/catapult/third_party/typ/typ/runner.py:210
    None
  _write at /b/s/w/ir/third_party/catapult/third_party/typ/typ/runner.py:697
    None
  write_text_file at /b/s/w/ir/third_party/catapult/third_party/typ/typ/host.py:179
    None
  _write at /b/s/w/ir/third_party/catapult/third_party/typ/typ/host.py:185
    None
IOError: [Errno 2] No such file or directory: '/b/s/w/ioQFW53M/output.json'
"""
 
Cc: perezju@chromium.org crouleau@chromium.org
Components: Tests>Telemetry
Cc: -nednguyen@chromium.org nedngu...@google.com

Comment 3 by benhenry@google.com, Jan 16 (6 days ago)

Components: Test>Telemetry

Comment 4 by benhenry@google.com, Jan 16 (6 days ago)

Components: -Tests>Telemetry

Sign in to add a comment