Get Telemetry test runner to support cmd flags needed by Findit |
|||
Issue description
To make Findit to support telemetry based tests, we need to make telemetry test runner to support some cmd flags needed by Findit:
1. --isolated-script-test-filter=A::B::C
a. This flag enables Findit to only rerun the failed/ flaked tests.
2. --isolated-script-test-repeat=30
a. This flag enables Findit to decide the number of runs for each
test based on the purpose of the rerun.
b. To be consistent with currently supported test types, the exec
order should be ABCABCABC...
3. --isolated-script-test-launcher-retry-limit=0
a. Since Findit has set the number of iterations of the rerun,
disable retry when test fails.
4. --isolated-script-test-also-run-disabled-tests
a. This flag is to enable Findit to rerun a test even if it’s
disabled, so that Findit can find the culprit of a flaky test even
if it has been disabled.
FYI: general guidance to make Findit support a new test type(https://docs.google.com/document/d/1XZrAecLT33sJng9JTHsWCNpcBVU_BT7weLE76nwsTXA/edit?usp=sharing).
,
Oct 5
I can't start owning Telemetry for the next ~4 weeks. If you want something done for this before then, please assign to Ned.
,
Oct 5
,
Oct 18
I still can't work on this until I am done with fixing stuff for my other team. Marking this available so anyone can work on it. Otherwise I will pick it back up later. |
|||
►
Sign in to add a comment |
|||
Comment 1 by nednguyen@chromium.org
, Oct 5