New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 772181 link

Starred by 1 user

Issue metadata

Status: Untriaged
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Feature

Blocked on:
issue 709161
issue 725774



Sign in to add a comment

Enable media_perftests to run continuously on CrOS

Project Member Reported by crouleau@chromium.org, Oct 5 2017

Issue description

Cc: achuith@chromium.org crouleau@chromium.org
+achuith@, any advice on how to do this? Swarming "Chrome.perf" pool doesn't have any ChromeOS bots in it.
Blockedon: 725774
Cc: ihf@chromium.org
Labels: -Pri-3 Pri-2
What are media_perftests? I think this may be a question for Ilja.
Cc: dalecur...@chromium.org
media_perftests are a set of microbenchmarks important to media playback performance. You can build them from a chromium checkout

$ ninja -C out/Release media_perftests

and run them

$ out/Release/media_perftests

they produce a bunch of values related to how quickly we can perform various operations on audio and video streams and also some important vector math operations as well. +dale is the expert on this benchmark.

These tests already run continuously on android, mac, linux, and windows. The results are graphed and alerted on from chromeperf.appspot.com dashboard.
Cc: owenlin@chromium.org
Thanks for the explanation. So it sounds like these have nothing to do with telemetry.

The way we would do this is to wrap the test with an autotest. Here's an example that I think is similar to your use case:
https://cs.corp.google.com/chromeos_public/src/third_party/autotest/files/client/site_tests/video_VEAPerf/video_VEAPerf.py
It runs a chrome binary and collects performance data.

I'm not sure who the owner is of this test, maybe owenlin@. I believe ihf@ has done something similar with gfx.


run_gtest_perf_test.py https://cs.chromium.org/chromium/src/testing/scripts/run_gtest_perf_test.py?q=testing/scripts/run_gtest_perf_test.py&dr is the python wrapper that we use for running media_perftests for Android, Windows, Mac, and Linux. It handles converting log statements containing results into the json format used by the dashboard (using generate_legacy_perf_dashboard_json.py) and then saving that result.json into the correct location to be picked up and pushed to the dashboard. 

Perhaps we could wrap run_gtest_perf_test.py in an autotest? Might be easier than redoing the work that it does.
Cc: dpranke@chromium.org eyaich@chromium.org
+dpranke@ for FYI/leadership in sewing back together the infrastructure cracks between CrOS and the rest of Chrome.
Cc: bpastene@chromium.org
I think this will fall out naturally as a result of the other work we're doing to enable perf tests for CrOS devices.
Project Member

Comment 9 by sheriffbot@chromium.org, Today (87 minutes ago)

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Sign in to add a comment