New issue
Advanced search Search tips

Issue 789796 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

Create a semi-automated stress run script for video testing

Project Member Reported by vsu...@chromium.org, Nov 30 2017

Issue description

We want to create a semi-automated process where a tester can start video playback on a DUT for overnight/overweekend runs and also start a script in the background that collects statistics about system performance, for instance:
- CPU utilization
- Memory consumption
- Power consumption

Currently, we test videos over long durations but our verification is simply to check for the absence of crashes. The hope is that added profiling will provide richer data and better bugs.

We are OK with moving devices to dev mode or test images for this. We want to start with stress testing non-DRM video or the RTC loopback test pages and later include DRM testing by whitelisting a few of the DUTs.

The desired process would look like this:
1. Select DUT. OK to be in Dev/Test mode.
2. Install build to test.
3. Log in.
4. Start data collection in shell
   - Specify which dimensions to record.
   - Specify sampling frequency
5. Navigate to video in webapp/play store app and start playback in loop mode.
6. Leave overnight/weekend.
7. Come back and stop video playback.
8. Stop script.
9. Analyze log using simple graphing tools and file bugs if needed

 
Cc: tfiga@chromium.org

Comment 2 by vsu...@google.com, Jan 11 2018

Owner: vsu...@chromium.org
Status: Assigned (was: Untriaged)

Sign in to add a comment