New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 638683 link

Starred by 0 users

Issue metadata

Status: Untriaged
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: All
Pri: 3
Type: Bug



Sign in to add a comment

repeat-count in run_tests broken

Project Member Reported by achuith@chromium.org, Aug 17 2016

Issue description

./run_tests --repeat-count=10 testBrowserCreation
only runs the test once.
 
I am not aware that we used to support this flag. What would happen if testBrowserCreation matches multiple test names? Do we run each of those tests 10 time?
I've used this quite a bit to reproduce flaky failures:
https://cs.chromium.org/chromium/src/third_party/catapult/telemetry/telemetry/testing/run_tests.py?l=52

Yup, we (used to) run all the tests matching the pattern N times.
Are you aware of any refactorings here? The flag is still in place but doesn't do anything.
Cc: dpranke@chromium.org
I think this flag may lost when we refactor telemetry's run_test to use typ.

+Dirk: does typ have the option to repeat test to be run x-time?
Not currently, no. We could add it, of course.
I feel like I used this like 2 months ago but maybe I'm mistaken. I looked at the logs and nothing stands out :/
Cc: st...@chromium.org
Cc: kbr@chromium.org
Owner: dpranke@chromium.org
Dirk: can we assign this bug to you? This is become relevant again as stability team want this option so they can implement flakiness finder (http://go/findit-regression-range-sample).

Comment 9 by st...@chromium.org, Sep 8 2016

This is not urgent.

Our plan is to fully support Swarmed gtest first, and then move on to support Telemetry-based tests (So no concrete timeline yet). When we are getting closer, will update this bug.
Status: Assigned (was: Untriaged)
Labels: OS-All
Labels: -Pri-2 Pri-3
Owner: ----
Status: Available (was: Assigned)
Given what's written above, it sounds like this isn't terribly urgent, so I probably won't work on it any time soon. Others are free to take a stab at it, of course.
Project Member

Comment 13 by sheriffbot@chromium.org, Mar 9 2018

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available. If you change it back, also remove the "Hotlist-Recharge-Cold" label.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Components: Test>Telemetry
Components: -Tests>Telemetry

Sign in to add a comment