New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 745104 link

Starred by 1 user

Issue metadata

Status: Available
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug

Blocked on:
issue 739863
issue 700160



Sign in to add a comment

Run media telemetry benchmark on the CQ

Project Member Reported by crouleau@chromium.org, Jul 18 2017

Issue description

We would like to run the media telemetry benchmark on the commit queue so that functional breakages to it will be noticed right away. Steps:

0. Wait for  issue 700160  so that the legacy benchmark is deleted. 

1. Rename "media.tough_video_cases_tbmv2" to "media.desktop" and rename "media.android.tough_video_cases_tbmv2" to "media.mobile".

2. Wait for issue 739863.

3. Enable media.desktop and media.mobile on the cq.
 
Do we normally run telemetry tests on the CQ? I thought we preferred browser tests for those?
Not media team but other teams have been running Telemetry tests on CQ.
1) chrome-benchmarking@ team run system health benchmarks on CQ for smoke testing.
2) GPu team use Telemetry to run WebGL correctness tests on CQ
It's nice to run Telemetry tests on the CQ so that the tests don't break as often. This will greatly reduce our workload as maintainers: we won't have to run bisect for benchmark failures and then go bug someone to fix something. Instead they will be notified before their CQ lands.

Also, since we already have to do the work to maintain these to make them work as performance tests, we may as well get the benefit of them running as functional tests as well to prevent bugs.
Project Member

Comment 4 by sheriffbot@chromium.org, Jul 18

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Owner: crouleau@chromium.org
Status: Assigned (was: Untriaged)
Has this been completed?  If not is it something we need/expect to do soon?
We need to take action or close as Won't Fix.
Cc: -johnchen@chromium.org dougman@chromium.org
Owner: ----
Status: Available (was: Assigned)

Sign in to add a comment