Enable media_perftests to run continuously on CrOS |
||||||||
Issue description
,
Dec 20 2017
,
Jan 3 2018
What are media_perftests? I think this may be a question for Ilja.
,
Jan 3 2018
media_perftests are a set of microbenchmarks important to media playback performance. You can build them from a chromium checkout $ ninja -C out/Release media_perftests and run them $ out/Release/media_perftests they produce a bunch of values related to how quickly we can perform various operations on audio and video streams and also some important vector math operations as well. +dale is the expert on this benchmark. These tests already run continuously on android, mac, linux, and windows. The results are graphed and alerted on from chromeperf.appspot.com dashboard.
,
Jan 3 2018
Thanks for the explanation. So it sounds like these have nothing to do with telemetry. The way we would do this is to wrap the test with an autotest. Here's an example that I think is similar to your use case: https://cs.corp.google.com/chromeos_public/src/third_party/autotest/files/client/site_tests/video_VEAPerf/video_VEAPerf.py It runs a chrome binary and collects performance data. I'm not sure who the owner is of this test, maybe owenlin@. I believe ihf@ has done something similar with gfx.
,
Jan 3 2018
run_gtest_perf_test.py https://cs.chromium.org/chromium/src/testing/scripts/run_gtest_perf_test.py?q=testing/scripts/run_gtest_perf_test.py&dr is the python wrapper that we use for running media_perftests for Android, Windows, Mac, and Linux. It handles converting log statements containing results into the json format used by the dashboard (using generate_legacy_perf_dashboard_json.py) and then saving that result.json into the correct location to be picked up and pushed to the dashboard. Perhaps we could wrap run_gtest_perf_test.py in an autotest? Might be easier than redoing the work that it does.
,
Jan 3 2018
+dpranke@ for FYI/leadership in sewing back together the infrastructure cracks between CrOS and the rest of Chrome.
,
Jan 23 2018
I think this will fall out naturally as a result of the other work we're doing to enable perf tests for CrOS devices.
,
Today
(87 minutes ago)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue. Sorry for the inconvenience if the bug really should have been left as Available. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot |
||||||||
►
Sign in to add a comment |
||||||||
Comment 1 by crouleau@chromium.org
, Dec 20 2017