New issue
Advanced search Search tips

Issue 745807 link

Starred by 1 user

Issue metadata

Status: Verified
Owner:
Closed: Jul 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

[telemetry] octane & kraken failing on Falco chromebook

Project Member Reported by cmt...@chromium.org, Jul 18 2017

Issue description

After loading falco release R60-9592.0.0 onto a falco chromebook, I tried running the octane and kraken telemetry tests on the Chromebook.  Both of them fail, complaining about the 'dump_power_status' command (see errors below).

Basic chromebook data:

localhost ~ # /opt/google/chrome/chrome --version
Google Chrome 60.0.3112.0 unknown
localhost ~ # more /etc/lsb-release
CHROMEOS_RELEASE_APPID={FA5D6766-6B3C-47C8-84DD-6A322C311569}
CHROMEOS_BOARD_APPID={FA5D6766-6B3C-47C8-84DD-6A322C311569}
CHROMEOS_CANARY_APPID={90F229CE-83E2-4FAF-8479-E368A34938B1}
DEVICETYPE=CHROMEBOOK
CHROMEOS_RELEASE_BUILDER_PATH=falco-release/R60-9592.0.0
GOOGLE_RELEASE=9592.0.0
CHROMEOS_DEVSERVER=
CHROMEOS_RELEASE_BOARD=falco
CHROMEOS_RELEASE_BUILD_NUMBER=9592
CHROMEOS_RELEASE_BRANCH_NUMBER=0
CHROMEOS_RELEASE_CHROME_MILESTONE=60
CHROMEOS_RELEASE_PATCH_NUMBER=0
CHROMEOS_RELEASE_TRACK=testimage-channel
CHROMEOS_RELEASE_DESCRIPTION=9592.0.0 (Official Build) dev-channel falco test
CHROMEOS_RELEASE_BUILD_TYPE=Official Build
CHROMEOS_RELEASE_NAME=Chrome OS
CHROMEOS_RELEASE_VERSION=9592.0.0
CHROMEOS_AUSERVER=https://tools.google.com/service/update2
localhost ~ # 

localhost ~ # python /usr/local/telemetry/src/tools/perf/run_benchmark --browser=sy
stem --output-format=chartjson  octane
[ RUN      ] http://chromium.github.io/octane/index.html?auto=1
Traceback (most recent call last):
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/
story_runner.py", line 90, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "/usr/local/telemetry/src/third_party/catapult/common/py_trace_event/py_trac
e_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/page/shar
ed_page_state.py", line 296, in RunStory
    self._current_page.Run(self)
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/page/__in
it__.py", line 109, in Run
    shared_state.page_test.DidNavigateToPage(self, current_tab)
  File "/usr/local/telemetry/src/third_party/catapult/common/py_trace_event/py_trac
e_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/usr/local/telemetry/src/tools/perf/benchmarks/octane.py", line 100, in Did
NavigateToPage
    self._power_metric.Start(page, tab)
  File "/usr/local/telemetry/src/tools/perf/metrics/power.py", line 90, in Start
    self._platform.StartMonitoringPower(self._browser)
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/core/plat
form.py", line 268, in StartMonitoringPower
    self._platform_backend.StartMonitoringPower(browser)
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/
platform/cros_platform_backend.py", line 154, in StartMonitoringPower
    self._powermonitor.StartMonitoringPower(browser)
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/
platform/power_monitor/cros_power_monitor.py", line 37, in StartMonitoringPower
    if self._IsOnBatteryPower():
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/
platform/power_monitor/cros_power_monitor.py", line 103, in _IsOnBatteryPower
    self._platform.RunCommand(['dump_power_status']))
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/
platform/cros_platform_backend.py", line 70, in RunCommand
    (str(args), stderr))
IOError: Failed to run: cmd = ['dump_power_status'], stderr = [0717/153221:ERROR:cr
os_config.cc(89)] Could not run command mosys platform model
[0717/153221:ERROR:prefs.cc(54)] Failed to init CrosConfig database.

[  FAILED  ] http://chromium.github.io/octane/index.html?auto=1 (18107 ms)

Traceback (most recent call last):
  RunBenchmark at /usr/local/telemetry/src/third_party/catapult/telemetry/telemetry
/internal/story_runner.py:383
    expectations=expectations)
  Run at /usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal
/story_runner.py:252
    _RunStoryAndProcessErrorIfNeeded(story, results, state, test)
  _RunStoryAndProcessErrorIfNeeded at /usr/local/telemetry/src/third_party/catapult
/telemetry/telemetry/internal/story_runner.py:90
    state.RunStory(results)
  traced_function at /usr/local/telemetry/src/third_party/catapult/common/py_trace_
event/py_trace_event/trace_event_impl/decorators.py:52
    return func(*args, **kwargs)
  RunStory at /usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/pag
e/shared_page_state.py:296
    self._current_page.Run(self)
  Run at /usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/page/__i
nit__.py:109
    shared_state.page_test.DidNavigateToPage(self, current_tab)
  traced_function at /usr/local/telemetry/src/third_party/catapult/common/py_trace_
event/py_trace_event/trace_event_impl/decorators.py:52
    return func(*args, **kwargs)
  DidNavigateToPage at /usr/local/telemetry/src/tools/perf/benchmarks/octane.py:100
    self._power_metric.Start(page, tab)
  Start at /usr/local/telemetry/src/tools/perf/metrics/power.py:90
    self._platform.StartMonitoringPower(self._browser)
  StartMonitoringPower at /usr/local/telemetry/src/third_party/catapult/telemetry/t
elemetry/core/platform.py:268
    self._platform_backend.StartMonitoringPower(browser)
  StartMonitoringPower at /usr/local/telemetry/src/third_party/catapult/telemetry/t
elemetry/internal/platform/cros_platform_backend.py:154
    self._powermonitor.StartMonitoringPower(browser)
  StartMonitoringPower at /usr/local/telemetry/src/third_party/catapult/telemetry/t
elemetry/internal/platform/power_monitor/cros_power_monitor.py:37
    if self._IsOnBatteryPower():
  _IsOnBatteryPower at /usr/local/telemetry/src/third_party/catapult/telemetry/tele
metry/internal/platform/power_monitor/cros_power_monitor.py:103
    self._platform.RunCommand(['dump_power_status']))
  RunCommand at /usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/i
nternal/platform/cros_platform_backend.py:70
    (str(args), stderr))
IOError: Failed to run: cmd = ['dump_power_status'], stderr = [0717/153221:ERROR:cr
os_config.cc(89)] Could not run command mosys platform model
[0717/153221:ERROR:prefs.cc(54)] Failed to init CrosConfig database.

Locals:
  args   : ['dump_power_status']
  stderr : '[0717/153221:ERROR:cros_config.cc(89)] Could not run command mosys plat
form model\n[0717/153221:ERROR:prefs.cc(54)] Failed to init CrosConfig database.\n'
  stdout : 'line_power_connected 1\nbattery_present 1\nbattery_percent 100.00\nbatt
ery_display_percent 100.00\nbattery_charge 6.49\nbattery_charge_full 6.49\nbattery_
charge_full_design 7.00\nbattery_current 0.00\nbattery_energy 48.00\nbattery_energy
_rate 0.00\nbattery_voltage 8.30\nbattery_discharging 0\n'


localhost ~ # python /usr/local/telemetry/src/tools/perf/run_benchmark --browser=sy
stem --output-format=chartjson  kraken
[ RUN      ] http://krakenbenchmark.mozilla.org/kraken-1.1/driver.html
Traceback (most recent call last):
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/
story_runner.py", line 90, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "/usr/local/telemetry/src/third_party/catapult/common/py_trace_event/py_trac
e_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/page/shar
ed_page_state.py", line 296, in RunStory
    self._current_page.Run(self)
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/page/__in
it__.py", line 109, in Run
    shared_state.page_test.DidNavigateToPage(self, current_tab)
  File "/usr/local/telemetry/src/third_party/catapult/common/py_trace_event/py_trac
e_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/usr/local/telemetry/src/tools/perf/benchmarks/kraken.py", line 87, in DidN
avigateToPage
    self._power_metric.Start(page, tab)
  File "/usr/local/telemetry/src/tools/perf/metrics/power.py", line 90, in Start
    self._platform.StartMonitoringPower(self._browser)
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/core/plat
form.py", line 268, in StartMonitoringPower
    self._platform_backend.StartMonitoringPower(browser)
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/
platform/cros_platform_backend.py", line 154, in StartMonitoringPower
    self._powermonitor.StartMonitoringPower(browser)
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/
platform/power_monitor/cros_power_monitor.py", line 37, in StartMonitoringPower
    if self._IsOnBatteryPower():
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/
platform/power_monitor/cros_power_monitor.py", line 103, in _IsOnBatteryPower
    self._platform.RunCommand(['dump_power_status']))
  File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/
platform/cros_platform_backend.py", line 70, in RunCommand
    (str(args), stderr))
IOError: Failed to run: cmd = ['dump_power_status'], stderr = [0717/154058:ERROR:cr
os_config.cc(89)] Could not run command mosys platform model
[0717/154058:ERROR:prefs.cc(54)] Failed to init CrosConfig database.


[  FAILED  ] http://krakenbenchmark.mozilla.org/kraken-1.1/driver.html (15043 ms)

Traceback (most recent call last):
  RunBenchmark at /usr/local/telemetry/src/third_party/catapult/telemetry/telemetry
/internal/story_runner.py:383
    expectations=expectations)
  Run at /usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal
/story_runner.py:252
    _RunStoryAndProcessErrorIfNeeded(story, results, state, test)
  _RunStoryAndProcessErrorIfNeeded at /usr/local/telemetry/src/third_party/catapult
/telemetry/telemetry/internal/story_runner.py:90
    state.RunStory(results)
  traced_function at /usr/local/telemetry/src/third_party/catapult/common/py_trace_
event/py_trace_event/trace_event_impl/decorators.py:52
    return func(*args, **kwargs)
  RunStory at /usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/pag
e/shared_page_state.py:296
    self._current_page.Run(self)
  Run at /usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/page/__i
nit__.py:109
    shared_state.page_test.DidNavigateToPage(self, current_tab)
  traced_function at /usr/local/telemetry/src/third_party/catapult/common/py_trace_
event/py_trace_event/trace_event_impl/decorators.py:52
    return func(*args, **kwargs)
  DidNavigateToPage at /usr/local/telemetry/src/tools/perf/benchmarks/kraken.py:87
    self._power_metric.Start(page, tab)
  Start at /usr/local/telemetry/src/tools/perf/metrics/power.py:90
    self._platform.StartMonitoringPower(self._browser)
  StartMonitoringPower at /usr/local/telemetry/src/third_party/catapult/telemetry/t
elemetry/core/platform.py:268
    self._platform_backend.StartMonitoringPower(browser)
  StartMonitoringPower at /usr/local/telemetry/src/third_party/catapult/telemetry/t
elemetry/internal/platform/cros_platform_backend.py:154
    self._powermonitor.StartMonitoringPower(browser)
  StartMonitoringPower at /usr/local/telemetry/src/third_party/catapult/telemetry/t
elemetry/internal/platform/power_monitor/cros_power_monitor.py:37
    if self._IsOnBatteryPower():
  _IsOnBatteryPower at /usr/local/telemetry/src/third_party/catapult/telemetry/tele
metry/internal/platform/power_monitor/cros_power_monitor.py:103
    self._platform.RunCommand(['dump_power_status']))
  RunCommand at /usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/i
nternal/platform/cros_platform_backend.py:70
    (str(args), stderr))
IOError: Failed to run: cmd = ['dump_power_status'], stderr = [0717/154058:ERROR:cr
os_config.cc(89)] Could not run command mosys platform model
[0717/154058:ERROR:prefs.cc(54)] Failed to init CrosConfig database.

Locals:
  args   : ['dump_power_status']
  stderr : '[0717/154058:ERROR:cros_config.cc(89)] Could not run command mosys plat
form model\n[0717/154058:ERROR:prefs.cc(54)] Failed to init CrosConfig database.\n'
  stdout : 'line_power_connected 1\nbattery_present 1\nbattery_percent 100.00\nbatt
ery_display_percent 100.00\nbattery_charge 6.49\nbattery_charge_full 6.49\nbattery_
charge_full_design 7.00\nbattery_current 0.00\nbattery_energy 48.00\nbattery_energy
_rate 0.00\nbattery_voltage 8.30\nbattery_discharging 0\n'

[  PASSED  ] 0 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ]  http://krakenbenchmark.mozilla.org/kraken-1.1/driver.html

1 FAILED TEST

View result at file:///usr/local/telemetry/src/tools/perf/results-chart.json



 
Cc: hablich@chromium.org sullivan@chromium.org
Owner: nedngu...@google.com
Status: Assigned (was: Untriaged)
That sounds more like that there is a problem with the test driver. Assigning to Ned for rerouting.
Components: -Tests>Telemetry Speed>Benchmarks
Owner: charliea@chromium.org
We should get rid of the power code in these benchmarks. Reassign this to Charlie
Ack - I'll add this to my TODO list.
Project Member

Comment 4 by bugdroid1@chromium.org, Jul 26 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/d19afa455243121f13cd100f6a1f8e896039a7fb

commit d19afa455243121f13cd100f6a1f8e896039a7fb
Author: Charlie Andrews <charliea@chromium.org>
Date: Wed Jul 26 21:54:31 2017

Remove power instrumentation from octane and kraken benchmarks

We now have other, more realistic ways to measure Chrome's power use
than with microbenchmarks.

NOTRY=true

Bug:  745807 
Change-Id: I9f0010c5fc0427667133598e8c6c3a8679429d20
Reviewed-on: https://chromium-review.googlesource.com/586920
Commit-Queue: Charlie Andrews <charliea@chromium.org>
Reviewed-by: Ned Nguyen <nednguyen@google.com>
Cr-Commit-Position: refs/heads/master@{#489767}
[modify] https://crrev.com/d19afa455243121f13cd100f6a1f8e896039a7fb/tools/perf/benchmarks/kraken.py
[modify] https://crrev.com/d19afa455243121f13cd100f6a1f8e896039a7fb/tools/perf/benchmarks/octane.py

Owner: cmt...@chromium.org
Status: Fixed (was: Assigned)
Marking this as fixed. Please reopen if you see the issue pop back up.

Comment 6 by cmt...@chromium.org, Sep 25 2017

Status: Verified (was: Fixed)

Sign in to add a comment