New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 594225 link

Starred by 1 user

Issue metadata

Status: Verified
Owner:
Last visit > 30 days ago
Closed: Jun 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Linux , Windows , Mac
Pri: 2
Type: Feature



Sign in to add a comment

Implement performance test to get CPU & Memory usage for MR

Project Member Reported by leilei@chromium.org, Mar 11 2016

Issue description

We should set up continuous performance test to get CPU and memory usage for MR with the following scenarios:
1. Open presentation API enabled web site, do nothing
2. Fling a video
3. Mirror a tab

The results should be posted to Chrome performance dashboard.
 
Project Member

Comment 1 by bugdroid1@chromium.org, Apr 20 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/50154e04711d8fac820f4f2c08519180c1f585bb

commit 50154e04711d8fac820f4f2c08519180c1f585bb
Author: leilei <leilei@chromium.org>
Date: Wed Apr 20 01:14:45 2016

Add new Telemetry tests to get CPU and memory usage for idle and flinging two test scenarios. Mirroring case will be added later.

It uses Chrome extension APIs to get CPU/memory usage for tab, browser, gpu and media router extension four processes. The test extension in this cl is implemented for this purpose. It collects the CPU/memory usage and posts it back the current tab.

We will get CPU/memory data each time when the Task Manager updates its process statistics, and will miss some data if media router extension is suspended.Right now I just use a simple way to present the results, which uses the average CPU/memory usage, but I feel this may not be the best way to present the results, since we have lots of 0 in extension CPU usage, it will definitely lower the average value. I need to figure out a better way to present the final results.

BUG= 594225 

Review URL: https://codereview.chromium.org/1843063004

Cr-Commit-Position: refs/heads/master@{#388393}

[modify] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/BUILD.gn
[modify] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/e2e_tests.gyp
[modify] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/media_router_perf_tests.isolate
[modify] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/media_router_tests.gypi
[modify] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/benchmarks/media_router_benchmark.py
[add] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/benchmarks/media_router_cpu_memory_metric.py
[rename] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/benchmarks/media_router_dialog_metric.py
[modify] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/benchmarks/media_router_measurements.py
[modify] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/benchmarks/pagesets/basic_test.html
[modify] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/benchmarks/pagesets/common.js
[add] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/benchmarks/pagesets/cpu_memory_script.js
[add] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/benchmarks/pagesets/media_router_page.py
[delete] https://crrev.com/0d2f423198b672a709c329d4a71a8b1f45462d78/chrome/test/media_router/telemetry/benchmarks/pagesets/media_router_pages.py
[add] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/benchmarks/pagesets/media_router_perf_pages.py
[add] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/extension/README.md
[add] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/extension/manifest.json
[add] https://crrev.com/50154e04711d8fac820f4f2c08519180c1f585bb/chrome/test/media_router/telemetry/extension/script.js

Project Member

Comment 2 by bugdroid1@chromium.org, Apr 26 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/667c742c4b79846571ea9c1817e4e19467132420

commit 667c742c4b79846571ea9c1817e4e19467132420
Author: leilei <leilei@chromium.org>
Date: Tue Apr 26 00:41:44 2016

Update cpu and memory metric calculation and several small improvements.

- Get rid of all the zero values when calculate the average value.
- Add mr_extension_wakeup_percentage metric to show how long the mr
extesion is active during the test.
- Start to collect data after start a new session and load the media for
flinging case, so we will only get the results after the cast session is stable.
- Use internal video instead of public one in continuous test.

BUG= 594225 

Review URL: https://codereview.chromium.org/1907073002

Cr-Commit-Position: refs/heads/master@{#389640}

[modify] https://crrev.com/667c742c4b79846571ea9c1817e4e19467132420/chrome/test/media_router/telemetry/benchmarks/media_router_cpu_memory_metric.py
[modify] https://crrev.com/667c742c4b79846571ea9c1817e4e19467132420/chrome/test/media_router/telemetry/benchmarks/pagesets/cpu_memory_script.js
[modify] https://crrev.com/667c742c4b79846571ea9c1817e4e19467132420/chrome/test/media_router/telemetry/benchmarks/pagesets/media_router_page.py
[modify] https://crrev.com/667c742c4b79846571ea9c1817e4e19467132420/chrome/test/media_router/telemetry/benchmarks/pagesets/media_router_perf_pages.py
[modify] https://crrev.com/667c742c4b79846571ea9c1817e4e19467132420/chrome/test/media_router/telemetry/media_router_config.py

Comment 4 by mfo...@chromium.org, May 12 2016

Cc: mfo...@chromium.org

Comment 6 by sko...@chromium.org, Jun 22 2016

Labels: Hotlist-Fixit-PE2016

Comment 7 by leilei@chromium.org, Jun 22 2016

Status: Verified (was: Assigned)
We have already set up the continuous automated performance test to get CPU and memory usage. So close this bug.

Sign in to add a comment