New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 897773 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Nov 20
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

37.3% regression in browser_tests at 601373:601383

Project Member Reported by emir...@chromium.org, Oct 22

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=897773

(For debugging:) Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?sid=0a54e2325fc80f289ec3fc84a83d471af90ab762d76b0dc55943dbbdb9b44b58


Bot(s) for this bug's original alert(s):

chromium-webrtc-rel-win10
Cc: niklase@chromium.org
Owner: sadrul@chromium.org
https://chromium.googlesource.com/chromium/src/+log/61ee8f21fe8b46464e50f7afd0beadf21f3d8259..5c2e137dc5294b30492a05a96a33bf0c7ff12908
sadrul@ your CL seems most related in the range. Can you check and tell if display latency difference is expected?
Cc: m...@chromium.org
/cc+ miu@ as a webrtc owner.

The metric is 'Total Latency Max', which makes me think a lower number is an improvement, rather than a regression. Would that be a correct assessment? If not, what is this measuring, exactly? These are not regular telemetry tests, so it's not super clear how to go through the numbers to understand the metrics.
BTW--I'm not a WebRTC owner. I own the screen capture stuff for the Cast use cases. :)

Looking at the graph, I can't tell if this is a false alarm or not: The graph doesn't specify whether "lower is better" or "higher is better." The test owner should fix that as a precondition to resolving this bug.

Speculatively, if this is measuring some kind of latency, and latency went down 37%, isn't that a *good* thing? Though, if "total latency" means "add up the per frame latency over all frames," then this is a regression since it infers the frame rate was reduced.
Cc: qiangchen@chromium.org mbonadei@chromium.org phoglund@chromium.org
[+qiangchen@chromium.org, mbonadei@chromium.org, phoglund@chromium.org]

cc'ing webrtc perf owners, per https://docs.google.com/spreadsheets/d/1xaAo0_SU3iDfGdqDJZX_jRV0QtkufwHUKH3kQKF3YQs/view

I can explain the tests.

> The metric is 'Total Latency Max', which makes me think a lower number is an improvement, rather than a regression. Would that be a correct assessment?
These tests measure various stages of display latency, from decoded frame to the screen. 'Total Latency Max' here is the time from RemoteVideoSourceDelegate::RenderFrame(WebRTC passes a decoded frame for render) to Display::DrawAndSwap. Lowering this is definitely an improvement. It seems like the most significant drop comes in the time between "VideoResourceUpdater::ObtainFrameResources" and "Display::DrawAndSwap" calls, avg ~10ms to ~1ms. I wanted to check that this is expected with your change, unless it is triggered by some other change in these tests.

https://chromeperf.appspot.com/group_report?sid=e1fe895d0b51912c419aa9bffc1aab5b55019034098bbdfe87910ba7f2956795
What the change does is potentially reduce the number of begin-frame messages sent to the clients. So if the gpu is busy processing each frame, then there will be fewer frames that are queued up. I can see how that could reduce the latency, but it is possible that it also drops the number of frames produced. So I am curious to know if there are other relevant metrics that could be affected. Perhaps 'Skipped Frames' measures this [1]?

[1] https://chromeperf.appspot.com/report?sid=3944efa2b9d32335ec7fd2174e883966fe91a5aaf1e0a3cd9f8586f5c80b15c4&start_rev=597460&end_rev=602260
> Perhaps 'Skipped Frames' measures this [1]?
Yes it does. There is a slight increase but it somehow didn't trigger an alert. If all is working as expected and this tradeoff makes sense, feel free to mark this as fixed.
Status: Fixed (was: Untriaged)
Closing as per comment #8.

Sign in to add a comment