Expected Queuing Time - Progressive Web Metric |
||||||||||||||||
Issue descriptionAdd Expected Input Latency Progressive Web Metric. Some discussion here: https://docs.google.com/document/d/1b9slyaB9yho91YTOkAQfpCdULFkZM9LqsipcX3t7He8/edit#heading=h.f294oh9v0jlx
,
Jul 5 2016
,
Jul 25 2016
,
Sep 17 2016
,
Oct 20 2016
,
Nov 22 2016
,
Nov 25 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/c60f3321df06eb2945441f7953e1747efadb943a commit c60f3321df06eb2945441f7953e1747efadb943a Author: catapult-deps-roller <catapult-deps-roller@chromium.org> Date: Fri Nov 25 00:25:59 2016 Roll src/third_party/catapult/ 3276375d2..671a65473 (7 commits). https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/3276375d2563..671a654736c2 $ git log 3276375d2..671a65473 --date=short --no-merges --format='%ad %ae %s' 2016-11-24 simonhatch Bisect - Fix compare_samples to read scalar values. 2016-11-24 hjd Fix getBoundingVisibleRect with offscreen elements 2016-11-24 ulan Helper functions for computing expected queueing time. 2016-11-23 achuith Autotest extension fix. 2016-11-23 benjhayden Document customizeSummaryOptions in how-to-write-metrics. 2016-11-23 fmeawad runtime_stats metric: only display the average in the dashboard 2016-11-23 simonhatch [bisect] - Clearly state bisect type in output. BUG= 668536 , 664515 ,625701, 654525 , 667813 Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, see: http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=catapult-sheriff@chromium.org Review-Url: https://codereview.chromium.org/2530973002 Cr-Commit-Position: refs/heads/master@{#434413} [modify] https://crrev.com/c60f3321df06eb2945441f7953e1747efadb943a/DEPS
,
Dec 2 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/cee1627f82063db73406364d15ab44e2cdd8177b commit cee1627f82063db73406364d15ab44e2cdd8177b Author: catapult-deps-roller <catapult-deps-roller@chromium.org> Date: Fri Dec 02 15:25:34 2016 Roll src/third_party/catapult/ 36566ddb1..e4611d299 (2 commits). https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/36566ddb1d53..e4611d2994c2 $ git log 36566ddb1..e4611d299 --date=short --no-merges --format='%ad %ae %s' 2016-12-02 ulan Function for computing max EQT in sliding window. 2016-12-02 nednguyen [telemetry] Add action_runner.NavigateBack() action BUG=625701, 669582 Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, see: http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=catapult-sheriff@chromium.org Review-Url: https://codereview.chromium.org/2550513003 Cr-Commit-Position: refs/heads/master@{#435939} [modify] https://crrev.com/cee1627f82063db73406364d15ab44e2cdd8177b/DEPS
,
Feb 3 2017
,
Feb 3 2017
,
Feb 9 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/244b7a1edf6afb44c124900684df6fc4862e4d02 commit 244b7a1edf6afb44c124900684df6fc4862e4d02 Author: catapult-deps-roller <catapult-deps-roller@chromium.org> Date: Thu Feb 09 17:03:56 2017 Roll src/third_party/catapult/ 5a31d0e07..ea587ba98 (1 commit). https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/5a31d0e078e1..ea587ba9812d $ git log 5a31d0e07..ea587ba98 --date=short --no-merges --format='%ad %ae %s' 2017-02-09 ulan Add estimated input latency metric. Created with: roll-dep src/third_party/catapult BUG=625701 Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, see: http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=catapult-sheriff@chromium.org Review-Url: https://codereview.chromium.org/2681993005 Cr-Commit-Position: refs/heads/master@{#449327} [modify] https://crrev.com/244b7a1edf6afb44c124900684df6fc4862e4d02/DEPS
,
Feb 13 2017
,
Feb 13 2017
ulan, just to confirm I understand this metric.. is this one way to describe it? You say it's "the maximum EQT in sliding time window of size 500ms." Is that consistent with one of the definitions in https://docs.google.com/document/d/13XKD4XQ5a_XA_or9ePZnD0rIJYRFUbdRH1kNAtOQyIc/edit#heading=h.f294oh9v0jlx ? Also, do the sliding time windows overlap?
,
Feb 13 2017
This corresponds to the EQTOfAPageLoadMax5Second() from the document, but instead of 5 seconds we take 500ms window. (see discussion of windows size https://groups.google.com/a/chromium.org/forum/?pli=1#!topic/progressive-web-metrics/vDXRUb_Ob9Y) > Also, do the sliding time windows overlap? Yes, the windows overlap. The metric computes max for all possible starting positions of the sliding window.
,
Feb 19 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/e86fbe70bbe580990957eca6a00531bd421358c9 commit e86fbe70bbe580990957eca6a00531bd421358c9 Author: catapult-deps-roller <catapult-deps-roller@chromium.org> Date: Sun Feb 19 03:45:52 2017 Roll src/third_party/catapult/ 36a508280..84a7af661 (27 commits). https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/36a50828018d..84a7af661032 $ git log 36a508280..84a7af661 --date=short --no-merges --format='%ad %ae %s' 2017-02-17 dtu Use third-party libraries in Catapult instead of the App Engine SDK. 2017-02-17 jessimb Adjusting css to make group by counter work for 3 numbers. 2017-02-17 jessimb Allow a user to enter a milestone param to view the table. 2017-02-17 jessimb Added new index for Anomaly. 2017-02-17 nednguyen Revert of [Telemetry] Migrate browser_test_runner to use typ as the test runner (patchset #1 id:1 of https://codereview.chromium.org/2700563004/ ) 2017-02-17 sullivan First version of benchmark health report. 2017-02-17 benjhayden Remove storyRepeatCounter. 2017-02-17 benjhayden Merge RelatedHistogram diagnostics. 2017-02-17 mikecase Fix for improper call to ps on Android versions greater than N. 2017-02-17 ulan Make estimatedInputLatency metric more friendly for traces without TTI. 2017-02-17 erikchen Use absolute pcs and load locations to symbolize on macOS. 2017-02-17 erikchen Fix a bug introduced in a refactor to the ELFSymbolizer. 2017-02-17 nednguyen [Telemetry] Remove --page-repeat flag 2017-02-17 hjd [dashboard] Avoid double XHR in /report 2017-02-16 dtu [pinpoint] Add Job.job_id property. 2017-02-16 nednguyen Roll typ v0.9.5 -> v0.9.11 (a277897604718c..f6afa2bbd1765b21e8) 2017-02-16 eakuefner [Dashboard] Only validate row_id for first row in add_point 2017-02-16 eakuefner [Dashboard] Use list_tests.GetTestsForTestPathDict in /graph_json 2017-02-16 eakuefner [Dashboard] Add test for listing tests with empty selection in test_path_dict 2017-02-16 benjhayden Fix merging Diagnostics. 2017-02-16 benjhayden Add CollectedRelatedEventSet diagnostic. 2017-02-16 eakuefner [Dashboard] Add capability for querying unselected tests by test_path_dict 2017-02-16 nednguyen [Telemetry] Migrate browser_test_runner to use typ as the test runner 2017-02-16 eakuefner [Dashboard] Add 'test_path_dict' request type to /list_tests 2017-02-16 benjhayden Replace values with histograms in metric_map_function. 2017-02-16 rnephew [WPR] Add log message when downloading archives. 2017-02-16 alexandermont Separate "time interval" from "metric collection" logic in power_metrics.html. Created with: roll-dep src/third_party/catapult BUG= 636153 ,625701, 677302 , 677302 , 689788 , 636153 Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, see: http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=catapult-sheriff@chromium.org Review-Url: https://codereview.chromium.org/2705883002 Cr-Commit-Position: refs/heads/master@{#451509} [modify] https://crrev.com/e86fbe70bbe580990957eca6a00531bd421358c9/DEPS
,
Feb 22 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/57a268525e7960919de4d9f161d5369b11e39ab6 commit 57a268525e7960919de4d9f161d5369b11e39ab6 Author: catapult-deps-roller <catapult-deps-roller@chromium.org> Date: Wed Feb 22 12:10:50 2017 Roll src/third_party/catapult/ e56eec861..0cc3f7ab5 (1 commit). https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/e56eec86141a..0cc3f7ab57ee $ git log e56eec861..0cc3f7ab5 --date=short --no-merges --format='%ad %ae %s' 2017-02-22 ulan Add a function that computes contribution of selected events to EQT. Created with: roll-dep src/third_party/catapult BUG=625701 Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, see: http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=catapult-sheriff@chromium.org Review-Url: https://codereview.chromium.org/2709963002 Cr-Commit-Position: refs/heads/master@{#452007} [modify] https://crrev.com/57a268525e7960919de4d9f161d5369b11e39ab6/DEPS
,
Feb 23 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/c629ba972b6af04055b2e1aa7c1067c4284ab923 commit c629ba972b6af04055b2e1aa7c1067c4284ab923 Author: catapult-deps-roller <catapult-deps-roller@chromium.org> Date: Thu Feb 23 22:48:48 2017 Roll src/third_party/catapult/ 0bd2f03be..6d8f67dbd (2 commits). https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/0bd2f03bedef..6d8f67dbd13f $ git log 0bd2f03be..6d8f67dbd --date=short --no-merges --format='%ad %ae %s' 2017-02-23 eakuefner [Dashboard] Allow lists of tests to be passed directly to /graph_json 2017-02-23 ulan Rename estimated_input_latency_*.html to expected_queueing_time_*.html. Created with: roll-dep src/third_party/catapult BUG=625701. Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, see: http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=catapult-sheriff@chromium.org Review-Url: https://codereview.chromium.org/2717593002 Cr-Commit-Position: refs/heads/master@{#452659} [modify] https://crrev.com/c629ba972b6af04055b2e1aa7c1067c4284ab923/DEPS
,
Feb 25 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/d07409811fbcafff033382f0a963b2ba30283e9d commit d07409811fbcafff033382f0a963b2ba30283e9d Author: catapult-deps-roller <catapult-deps-roller@chromium.org> Date: Sat Feb 25 00:56:19 2017 Roll src/third_party/catapult/ 794fff6c8..246a39a82 (13 commits). https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/794fff6c8147..246a39a82c22 $ git log 794fff6c8..246a39a82 --date=short --no-merges --format='%ad %ae %s' 2017-02-24 benjhayden Remove metric filename check. 2017-02-24 ulan Fix the task overlap check in maxExpectedQueueingTimeInSlidingWindow. 2017-02-24 sullivan Add link to benchmark health report from navbar 2017-02-24 sullivan Add number of comments to bug details. 2017-02-24 sullivan Benchmark health report: clearly show what isn't monitored. 2017-02-24 alexandermont Remove comment about Renard series for preferred numbers. 2017-02-24 mythria Fix the diagnosticMap key in the RuntimeStatsTotalMetric. 2017-02-24 hjd [tracing] Add two regression tests for tabView 2017-02-24 dtu Add 404 handling and optional hostname parameter to gitiles_service. 2017-02-23 eakuefner [Dashboard] Remove multi-bot logic from test-picker 2017-02-23 benjhayden Fix style in tracingMetric. 2017-02-23 benjhayden Require metric names to end with "Metric". 2017-02-23 sullivan Add new endpoint to get bug details as JSON. Created with: roll-dep src/third_party/catapult BUG=625701#,686250 Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, see: http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=catapult-sheriff@chromium.org Review-Url: https://codereview.chromium.org/2718513004 Cr-Commit-Position: refs/heads/master@{#453031} [modify] https://crrev.com/d07409811fbcafff033382f0a963b2ba30283e9d/DEPS
,
Feb 26 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/00109a3ffd77b5ee226bf6584a18f16ba85ce5c2 commit 00109a3ffd77b5ee226bf6584a18f16ba85ce5c2 Author: ulan <ulan@chromium.org> Date: Sun Feb 26 20:44:29 2017 Enable the EQT metric for system health benchmarks. BUG=chromium:625701 Review-Url: https://codereview.chromium.org/2713093004 Cr-Commit-Position: refs/heads/master@{#453120} [modify] https://crrev.com/00109a3ffd77b5ee226bf6584a18f16ba85ce5c2/tools/perf/benchmarks/system_health.py
,
Mar 6 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/257e0f63627318932ea2a67c2bcf88614cadae1f commit 257e0f63627318932ea2a67c2bcf88614cadae1f Author: catapult-deps-roller <catapult-deps-roller@chromium.org> Date: Mon Mar 06 13:09:03 2017 Roll src/third_party/catapult/ 2de8e90be..353ee60a4 (1 commit) https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/2de8e90be0fc..353ee60a4567 $ git log 2de8e90be..353ee60a4 --date=short --no-merges --format='%ad %ae %s' 2017-03-06 ulan Refactor estimated input latency tests to test behaviours independently. Created with: roll-dep src/third_party/catapult BUG=625701 Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, see: http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=catapult-sheriff@chromium.org Review-Url: https://codereview.chromium.org/2732973002 Cr-Commit-Position: refs/heads/master@{#454857} [modify] https://crrev.com/257e0f63627318932ea2a67c2bcf88614cadae1f/DEPS
,
Mar 20 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/db7229d4e09f68dc97672120b8212541eab7d91b commit db7229d4e09f68dc97672120b8212541eab7d91b Author: ulan <ulan@chromium.org> Date: Mon Mar 20 16:37:52 2017 Enable EQT metric for v8.browsing* benchmarks. BUG=chromium:625701 Review-Url: https://codereview.chromium.org/2757283002 Cr-Commit-Position: refs/heads/master@{#458086} [modify] https://crrev.com/db7229d4e09f68dc97672120b8212541eab7d91b/tools/perf/benchmarks/v8_browsing.py
,
Mar 21 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/0e3b3bd54f8db5bfbe8a985aa1eb280819e6baaa commit 0e3b3bd54f8db5bfbe8a985aa1eb280819e6baaa Author: ulan <ulan@chromium.org> Date: Tue Mar 21 12:17:59 2017 Enable EQT metric for v8.infinite_scroll* benchmarks. BUG=chromium:625701 Review-Url: https://codereview.chromium.org/2764493002 Cr-Commit-Position: refs/heads/master@{#458379} [modify] https://crrev.com/0e3b3bd54f8db5bfbe8a985aa1eb280819e6baaa/tools/perf/benchmarks/v8.py
,
Mar 22 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/6fd78003bc0d9f00fb49e195c762eb227a3f2134 commit 6fd78003bc0d9f00fb49e195c762eb227a3f2134 Author: catapult-deps-roller <catapult-deps-roller@chromium.org> Date: Wed Mar 22 11:34:07 2017 Roll src/third_party/catapult/ 8cbbd7f6c..1dd418704 (1 commit) https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/8cbbd7f6c620..1dd41870427d $ git log 8cbbd7f6c..1dd418704 --date=short --no-merges --format='%ad %ae %s' 2017-03-22 ulan Add a diagnostic metric that computes V8 contribution to EQT. Created with: roll-dep src/third_party/catapult BUG=625701 Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, see: http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=catapult-sheriff@chromium.org Review-Url: https://codereview.chromium.org/2766983003 Cr-Commit-Position: refs/heads/master@{#458718} [modify] https://crrev.com/6fd78003bc0d9f00fb49e195c762eb227a3f2134/DEPS
,
Mar 23 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/3199236950a606ffd41f20b4e9189ad68d253350 commit 3199236950a606ffd41f20b4e9189ad68d253350 Author: catapult-deps-roller <catapult-deps-roller@chromium.org> Date: Thu Mar 23 11:29:18 2017 Roll src/third_party/catapult/ 1ee9f83bf..7c7b8a1de (1 commit) https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/1ee9f83bf02d..7c7b8a1defa3 $ git log 1ee9f83bf..7c7b8a1de --date=short --no-merges --format='%ad %ae %s' 2017-03-23 ulan Speed up the EQT metric computation. Created with: roll-dep src/third_party/catapult BUG=625701 Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, see: http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=catapult-sheriff@chromium.org Review-Url: https://codereview.chromium.org/2768043003 Cr-Commit-Position: refs/heads/master@{#459046} [modify] https://crrev.com/3199236950a606ffd41f20b4e9189ad68d253350/DEPS
,
Mar 23 2017
The metric is enabled for system health benchmarks and for v8 benchmarks with v8 diagnostic breakdowns. Example: https://chromeperf.appspot.com/report?sid=dacb631715ca8e909254e149d6638204621e75894f5e4a71f34b4636a9077c0b I think we can close this issue now.
,
Mar 23 2017
This issue was intended to be the metabug for getting this implemented across TBMv2, UMA, etc. I think we should leave this open for that reason. We should probably not have blocked 691581 on this though, we should have made a separate bug to track adding EQT to telemetry. I also would hesitate to call the TBMv2 work done until we've gotten a better TTI metric implemented, and we've determined that the variability is reasonable.
,
Mar 23 2017
Makes sense, I misunderstood the scope of this issue :) > I also would hesitate to call the TBMv2 work done until we've gotten a better TTI metric implemented, and we've determined that the variability is reasonable. Agreed
,
Apr 11 2017
,
Apr 13 2017
,
Oct 4 2017
,
Oct 10 2017
,
Feb 1 2018
We're still seeing a fair amount of noise in TBMv2, due to the TTI implementation.
,
Mar 16 2018
,
Jun 27 2018
Is there any plan to fix noise problems? Or should this bug be closed?
,
Jun 27 2018
I believe Deep took a stab at this, but it's still pretty noisy. Deep, is there anything else here?
,
Oct 22
Please de-prioritize or update what the status of this is.
,
Oct 23
Ping Deep re #35.
,
Dec 12
|
||||||||||||||||
►
Sign in to add a comment |
||||||||||||||||
Comment 1 by u...@chromium.org
, Jul 5 2016