New issue
Advanced search Search tips

Issue 711065 link

Starred by 1 user

Issue metadata

Status: Available
Owner: ----
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

Support disabling failing stories in a benchmark

Project Member Reported by nedngu...@google.com, Apr 12 2017

Issue description

This is the cover bug for support disabling only failing stories in a benchmark on specific platforms (instead of disabling the whole benchmark). Spec & design doc will be added later.
 
Summary: Support disabling failing stories in a benchmark (was: Support disabling a subset of failing stories in a benchmark)
Description: Show this description
Status: Assigned (was: Untriaged)
Project Member

Comment 4 by bugdroid1@chromium.org, May 17 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/26d71b4f8cbf1fd071ae1817918857613d9338f7

commit 26d71b4f8cbf1fd071ae1817918857613d9338f7
Author: catapult-deps-roller@chromium.org <catapult-deps-roller@chromium.org>
Date: Wed May 17 05:16:56 2017

Roll src/third_party/catapult/ 37015fb47..dab2aa44c (13 commits)

https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/37015fb470d8..dab2aa44c6cd

$ git log 37015fb47..dab2aa44c --date=short --no-merges --format='%ad %ae %s'
2017-05-16 nednguyen Revert of Remove webrtc_rendering_stats TBMv1 metrics (patchset #2 id:20001 of https://codereview.chromium.org/2890443002/ )
2017-05-16 rnephew Revert of [Telemetry][CodeHealth] Make unittests with fake platforms use fakes.FakePlatform (patchset #3 id:60001 of https://codereview.chromium.org/2889583003/ )
2017-05-16 rnephew [Telemetry][CodeHealth] Make unittests with fake platforms use fakes.FakePlatform
2017-05-16 ctzsm Remove android-webview-shell
2017-05-16 rnephew [Telemetry] Add Expectation module that enables disabling benchmarks/stories
2017-05-16 perezju [common/battor] Fix errors while logging
2017-05-16 nednguyen Remove webrtc_rendering_stats TBMv1 metrics
2017-05-16 perezju [Telemetry] Stop tracing/metrics before closing the browser
2017-05-16 nednguyen Remove v8_gc_latency TBMv1 metric
2017-05-16 ulan Revert of Fix main frame detection in loading metrics. (patchset #7 id:120001 of https://codereview.chromium.org/2862103002/ )
2017-05-15 jreck Quick fix to avoid corruption from binder_parser
2017-05-15 ctzsm Rename AndroidWebView.apk to WebViewInstrumentation.apk
2017-05-15 ulan Fix main frame detection in loading metrics.

Created with:
  roll-dep src/third_party/catapult
BUG= 701938 ,711065, 719447 , 720317 , 692112 , 701938 , 692112 


Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md

If the roll is causing failures, see:
http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls


CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel
TBR=sullivan@chromium.org

Change-Id: I01ecaf24a0ad46e599b4e1272e8bb6204cabf75f
Reviewed-on: https://chromium-review.googlesource.com/507032
Reviewed-by: <catapult-deps-roller@chromium.org>
Commit-Queue: <catapult-deps-roller@chromium.org>
Cr-Commit-Position: refs/heads/master@{#472336}
[modify] https://crrev.com/26d71b4f8cbf1fd071ae1817918857613d9338f7/DEPS

Project Member

Comment 5 by bugdroid1@chromium.org, May 18 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/6f8d636e0a218db1d2b6bee09250566a89eaa02c

commit 6f8d636e0a218db1d2b6bee09250566a89eaa02c
Author: catapult-deps-roller@chromium.org <catapult-deps-roller@chromium.org>
Date: Thu May 18 07:51:55 2017

Roll src/third_party/catapult/ d76621c5e..dd9db5d3f (5 commits)

https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/d76621c5ec84..dd9db5d3f658

$ git log d76621c5e..dd9db5d3f --date=short --no-merges --format='%ad %ae %s'
2017-05-17 kbr Pass False for fromSurface argument to Page.captureScreenshot.
2017-05-17 rnephew [Telemetry] Rename DisableBenchmark to PermenantlyDisableBenchmark in StoryExpectations
2017-05-17 sullivan Fix typo in api documentation
2017-05-17 kbr Expose browser command line via SystemInfo.
2017-05-17 sullivan Add documenation on the alert list JSON format.

Created with:
  roll-dep src/third_party/catapult
BUG= 714058 ,711065, 718635 


Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md

If the roll is causing failures, see:
http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls


CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel
TBR=sullivan@chromium.org

Change-Id: I7d0e18ec4ac4032ca270f38f6f406bf1357a33f0
Reviewed-on: https://chromium-review.googlesource.com/508260
Reviewed-by: <catapult-deps-roller@chromium.org>
Commit-Queue: <catapult-deps-roller@chromium.org>
Cr-Commit-Position: refs/heads/master@{#472727}
[modify] https://crrev.com/6f8d636e0a218db1d2b6bee09250566a89eaa02c/DEPS

Project Member

Comment 6 by bugdroid1@chromium.org, May 19 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/44116dd8f6d76d2b9c85d51e5916fe08604407a6

commit 44116dd8f6d76d2b9c85d51e5916fe08604407a6
Author: catapult-deps-roller@chromium.org <catapult-deps-roller@chromium.org>
Date: Fri May 19 03:49:31 2017

Roll src/third_party/catapult/ b1c6aa75f..16b38d742 (4 commits)

https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/b1c6aa75f15a..16b38d742568

$ git log b1c6aa75f..16b38d742 --date=short --no-merges --format='%ad %ae %s'
2017-05-18 bpastene devil: Add Via Labs usb hubs to usb_hubs.py
2017-05-18 benjhayden Make autocomplete-box case-insensitive.
2017-05-18 rnephew [Telemetry] Make story runner use story expectations.
2017-05-18 sullivan Add simonhatch to dasboard/OWNERS.

Created with:
  roll-dep src/third_party/catapult
BUG= 670879 ,711065


Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md

If the roll is causing failures, see:
http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls


CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel
TBR=sullivan@chromium.org

Change-Id: I1b0c065f92abd17ad8bab55c9415c648e11c92e0
Reviewed-on: https://chromium-review.googlesource.com/508867
Reviewed-by: <catapult-deps-roller@chromium.org>
Commit-Queue: <catapult-deps-roller@chromium.org>
Cr-Commit-Position: refs/heads/master@{#473068}
[modify] https://crrev.com/44116dd8f6d76d2b9c85d51e5916fe08604407a6/DEPS

Project Member

Comment 7 by bugdroid1@chromium.org, May 24 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/54bf385aa6becac4aeecd2bf79604bc9421b6306

commit 54bf385aa6becac4aeecd2bf79604bc9421b6306
Author: catapult-deps-roller@chromium.org <catapult-deps-roller@chromium.org>
Date: Wed May 24 03:47:30 2017

Roll src/third_party/catapult/ 51b31788b..f136f4800 (2 commits)

https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/51b31788b65c..f136f480014c

$ git log 51b31788b..f136f4800 --date=short --no-merges --format='%ad %ae %s'
2017-05-23 rnephew [Telemetry] Add android device specific test conditions to StoryExpectations
2017-05-23 kbr Fixed specification of Page.captureScreenshot's fromSurface argument.

Created with:
  roll-dep src/third_party/catapult
BUG=711065, 714058 


Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md

If the roll is causing failures, see:
http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls


CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel
TBR=sullivan@chromium.org

Change-Id: I5b265c2cf360b33111f678fed0abf43c32790fbf
Reviewed-on: https://chromium-review.googlesource.com/513473
Reviewed-by: <catapult-deps-roller@chromium.org>
Commit-Queue: <catapult-deps-roller@chromium.org>
Cr-Commit-Position: refs/heads/master@{#474152}
[modify] https://crrev.com/54bf385aa6becac4aeecd2bf79604bc9421b6306/DEPS

Project Member

Comment 8 by sheriffbot@chromium.org, Jul 20 2017

Labels: Hotlist-Google
Owner: ----
Status: Available (was: Assigned)
Components: Test>Telemetry
Components: -Speed>Telemetry

Sign in to add a comment