New issue
Advanced search Search tips

Issue 755731 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 753763
Owner: ----
Closed: Aug 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: ----
Type: ----



Sign in to add a comment

battor.steady_state failing on 2 builders

Project Member Reported by simonhatch@chromium.org, Aug 15 2017

Issue description

battor.steady_state failing on 2 builders

Builders failed on: 
- Android Nexus5X Perf: 
  https://build.chromium.org/p/chromium.perf/builders/Android%20Nexus5X%20Perf
- Mac Retina Perf: 
  https://build.chromium.org/p/chromium.perf/builders/Mac%20Retina%20Perf


This kinda looks like the duration shot up past the 1 hr limit around Aug 1: https://chromeperf.appspot.com/report?sid=e56ca7e209bad745bc1267218800ae13a9e2de5b7f1a4afb0bfe2b69f7368619
 
Might be nothing, but this is interesting:

(INFO) 2017-08-15 02:20:55,366 cloud_storage._GetLocked:339  Downloading gs://chromium-telemetry/binary_dependencies/battor/battor_agent_binary_2d1610374495130d8eefc731f3f38be63bb21f2e to /b/s/w/ir/third_party/catapult/common/battor/bin/darwin/x86_64/battor_agent
(ERROR) 2017-08-15 02:21:35,835 battor_wrapper._FlashBattOr:175  Git hash returned from BattOr was not as expected: 


Full snippet from log:

[ RUN      ] http://www.slideshare.net/patrickmeenan
(INFO) 2017-08-15 02:20:55,352 chrome_tracing_agent._CreateTraceConfigFile:286  Trace config file string: {"trace_config": {"included_categories": ["toplevel", "rail", "blink.console"], "record_mode": "record-as-much-as-possible"}}
(INFO) 2017-08-15 02:20:55,366 cloud_storage._GetLocked:339  Downloading gs://chromium-telemetry/binary_dependencies/battor/battor_agent_binary_2d1610374495130d8eefc731f3f38be63bb21f2e to /b/s/w/ir/third_party/catapult/common/battor/bin/darwin/x86_64/battor_agent
(ERROR) 2017-08-15 02:21:35,835 battor_wrapper._FlashBattOr:175  Git hash returned from BattOr was not as expected: [0815/022135.835002:FATAL:battor_agent_bin.cc(91)] Fatal error when communicating with the BattOr: TOO MANY COMMAND RETRIES
Traceback (most recent call last):
  File "/b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py", line 162, in _FlashBattOr
    device_git_hash = self.GetFirmwareGitHash()
  File "/b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py", line 393, in GetFirmwareGitHash
    int(self._git_hash, 16)
ValueError: invalid literal for int() with base 16: '[0815/022135.835002:FATAL:battor_agent_bin.cc(91)] Fatal error when communicating with the BattOr: TOO MANY COMMAND RETRIES'
(WARNING) 2017-08-15 02:21:35,837 shared_page_state.DumpStateUponFailure:140  Cannot dump browser state: No browser.
Traceback (most recent call last):
  File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 97, in _RunStoryAndProcessErrorIfNeeded
    test.WillRunStory(state.platform)
  File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/web_perf/timeline_based_measurement.py", line 280, in WillRunStory
    platform.tracing_controller.StartTracing(self._tbm_options.config)
  File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/core/tracing_controller.py", line 43, in StartTracing
    self._tracing_controller_backend.StartTracing(tracing_config, timeout)
  File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py", line 91, in StartTracing
    started = agent.StartAgentTracing(config, timeout)
  File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_agent/battor_tracing_agent.py", line 73, in StartAgentTracing
    self._battor.StartTracing()
  File "/b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py", line 234, in StartTracing
    self._FlashBattOr()
  File "/b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py", line 176, in _FlashBattOr
    self.StopShell()
  File "/b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py", line 221, in StopShell
    self._SendBattOrCommand(self._EXIT_CMD, check_return=False)
  File "/b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py", line 346, in _SendBattOrCommand
    status = self._SendBattOrCommandImpl(cmd)
  File "/b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py", line 341, in _SendBattOrCommandImpl
    self._battor_shell.stdin.write('%s\n' % cmd)
IOError: [Errno 32] Broken pipe

(INFO) 2017-08-15 02:21:36,015 exception_formatter.PrintFormattedException:19  Try printing formatted exception: None None None

Exception raised when cleaning story run: 

Traceback (most recent call last):
  _RunStoryAndProcessErrorIfNeeded at /b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/story_runner.py:130
    test.DidRunStory(state.platform, results)
  DidRunStory at /b/s/w/ir/third_party/catapult/telemetry/telemetry/web_perf/timeline_based_measurement.py:310
    trace_result = platform.tracing_controller.StopTracing()
  StopTracing at /b/s/w/ir/third_party/catapult/telemetry/telemetry/core/tracing_controller.py:47
    return self._tracing_controller_backend.StopTracing()
  StopTracing at /b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py:109
    self._IssueClockSyncMarker()
  _IssueClockSyncMarker at /b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py:213
    self._RecordIssuerClockSyncMarker)
  RecordClockSyncMarker at /b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_agent/chrome_tracing_agent.py:178
    raise ChromeClockSyncError('Cannot issue clock sync. No devtools clients')
ChromeClockSyncError: Cannot issue clock sync. No devtools clients

Locals:
  devtools_clients                             : []
  record_controller_clock_sync_marker_callback : <bound method TracingControllerBackend._RecordIssuerClockSyncMarker of <telemetry.internal.platform.tracing_controller_backend.TracingControllerBackend object at 0x10b8ac710>>
  sync_id                                      : 'f832f255-823b-4166-a943-0ab9c0d2d248'

[  FAILED  ] http://www.slideshare.net/patrickmeenan (40664 ms)
(INFO) 2017-08-15 02:21:36,992 exception_formatter.PrintFormattedException:19  Try printing formatted exception: None None None

Traceback (most recent call last):
  RunBenchmark at /b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/story_runner.py:328
    expectations=expectations, metadata=benchmark.GetMetadata())
  Run at /b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/story_runner.py:203
    _RunStoryAndProcessErrorIfNeeded(story, results, state, test)
  _RunStoryAndProcessErrorIfNeeded at /b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/story_runner.py:97
    test.WillRunStory(state.platform)
  WillRunStory at /b/s/w/ir/third_party/catapult/telemetry/telemetry/web_perf/timeline_based_measurement.py:280
    platform.tracing_controller.StartTracing(self._tbm_options.config)
  StartTracing at /b/s/w/ir/third_party/catapult/telemetry/telemetry/core/tracing_controller.py:43
    self._tracing_controller_backend.StartTracing(tracing_config, timeout)
  StartTracing at /b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py:91
    started = agent.StartAgentTracing(config, timeout)
  StartAgentTracing at /b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_agent/battor_tracing_agent.py:73
    self._battor.StartTracing()
  StartTracing at /b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py:234
    self._FlashBattOr()
  _FlashBattOr at /b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py:176
    self.StopShell()
  StopShell at /b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py:221
    self._SendBattOrCommand(self._EXIT_CMD, check_return=False)
  _SendBattOrCommand at /b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py:346
    status = self._SendBattOrCommandImpl(cmd)
  _SendBattOrCommandImpl at /b/s/w/ir/third_party/catapult/common/battor/battor/battor_wrapper.py:341
    self._battor_shell.stdin.write('%s\n' % cmd)
IOError: [Errno 32] Broken pipe

Locals:
  cmd : 'Exit'

(INFO) 2017-08-15 02:21:36,992 cloud_storage.Insert:377  Uploading /b/s/w/it3cYsS9/tmpjMX_pZ.png to gs://chrome-telemetry-output/profiler-file-id_0-2017-08-15_02-21-3665893.png
View generated profiler files online at https://console.developers.google.com/m/cloudstorage/b/chrome-telemetry-output/o/profiler-file-id_0-2017-08-15_02-21-3665893.png for page http://www.slideshare.net/patrickmeenan
[  PASSED  ] 1 test.
[  FAILED  ] 1 test, listed below:
[  FAILED  ]  http://www.slideshare.net/patrickmeenan

1 FAILED TEST
Mergedinto: 753763
Status: Duplicate (was: Available)

Sign in to add a comment