New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 616766 link

Starred by 3 users

Issue metadata

Status: Fixed
Owner:
Closed: Dec 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: All
Pri: 2
Type: Bug



Sign in to add a comment

Add telemetry metrics for measuring UseCounters

Project Member Reported by rbyers@chromium.org, Jun 2 2016

Issue description

Although telemetry is typically used for measuring performance, it could also be used for measuring compat impact.  In particular, I've found it useful to run the top 10k on the telemetry cluster (https://www.chromium.org/developers/cluster-telemetry) and record which URLs hit specific UseCounters (and potentially how a chromium CL changes that).

I'd like to land the scripts for this and formalize some docs.  

Longer term, rmistry is working on some improvements to cluster telemetry to make this sort of thing more useful (https://docs.google.com/document/d/1ziof4lNwDFXyerVbEocdF3_DdUHVnD3FKYB9rShztuE/edit)
 
Cc: kouhei@chromium.org bashi@chromium.org
+Bashi, Kouhei: the cluster telemetry infra may also be very useful for the purpose of writing report since they can handle a run against thousands of sites.

Comment 3 by rmis...@google.com, Jun 3 2016

Quick update on CT:
CT has been converted completely to use swarming ( bug skia:5245 ): No more waiting in queue, more robust and faster. Now has a pool of 305 machines.

Sometime next week I am going to get started on the new analysis page ( bug skia:5316 ) that Rick linked to in the summary.


Bashi, Kouhei: Talk to me if you need more info on CT.
Cc: cbruni@chromium.org

Comment 5 by rbyers@chromium.org, Jun 23 2016

Labels: -Hotlist-CompatTooling Hotlist-Predictability

Comment 6 by rbyers@chromium.org, Jun 23 2016

Labels: -Hotlist-Predictability Hotlist-PredictabilityInfra
Labels: M-54
Cc: rbyers@chromium.org phil...@opera.com chrishtr@chromium.org dk...@chromium.org sim...@opera.com dglazkov@chromium.org
 Issue 584766  has been merged into this issue.
Cc: -phil...@opera.com
Labels: M-57
Labels: -M-54
Status: Fixed (was: Started)
It looks like we're not going to be able to land these patches anytime soon (waiting on improvements to the architecture of telemetry).  But getting the patches _landed_ isn't really necessary.  I've fixed up the unlanded patches and written up details instructions here: https://docs.google.com/document/d/1FSzJm2L2ow6pZTM_CuyHNJecXuX7Mx3XmBzL4SFHyLA/edit#

I've also written an overview of the different compat analysis tools here: https://www.chromium.org/blink/platform-predictability/compat-tools

I think that's enough for now.  We'll revisit based on how much usage these tools get and how much of a pain maintaining the unlanded patches are.
Components: Blink>Infra>Predictability
Labels: -Hotlist-PredictabilityInfra

Sign in to add a comment