Run media telemetry benchmark on the CQ |
||||
Issue descriptionWe would like to run the media telemetry benchmark on the commit queue so that functional breakages to it will be noticed right away. Steps: 0. Wait for issue 700160 so that the legacy benchmark is deleted. 1. Rename "media.tough_video_cases_tbmv2" to "media.desktop" and rename "media.android.tough_video_cases_tbmv2" to "media.mobile". 2. Wait for issue 739863. 3. Enable media.desktop and media.mobile on the cq.
,
Jul 18 2017
Not media team but other teams have been running Telemetry tests on CQ. 1) chrome-benchmarking@ team run system health benchmarks on CQ for smoke testing. 2) GPu team use Telemetry to run WebGL correctness tests on CQ
,
Jul 18 2017
It's nice to run Telemetry tests on the CQ so that the tests don't break as often. This will greatly reduce our workload as maintainers: we won't have to run bisect for benchmark failures and then go bug someone to fix something. Instead they will be notified before their CQ lands. Also, since we already have to do the work to maintain these to make them work as performance tests, we may as well get the benefit of them running as functional tests as well to prevent bugs.
,
Jul 18
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue. Sorry for the inconvenience if the bug really should have been left as Available. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
Jul 23
Has this been completed? If not is it something we need/expect to do soon? We need to take action or close as Won't Fix.
,
Oct 2
|
||||
►
Sign in to add a comment |
||||
Comment 1 by dalecur...@chromium.org
, Jul 18 2017