New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 892707 link

Starred by 1 user

Issue metadata

Status: Available
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Get Telemetry test runner to support cmd flags needed by Findit

Project Member Reported by chanli@chromium.org, Oct 5

Issue description

To make Findit to support telemetry based tests, we need to make telemetry test runner to support some cmd flags needed by Findit:

1. --isolated-script-test-filter=A::B::C
  a. This flag enables Findit to only rerun the failed/ flaked tests.
2. --isolated-script-test-repeat=30
  a. This flag enables Findit to decide the number of runs for each 
     test based on the purpose of the rerun.
  b. To be consistent with currently supported test types, the exec 
     order should be ABCABCABC...
3. --isolated-script-test-launcher-retry-limit=0
  a. Since Findit has set the number of iterations of the rerun, 
     disable retry when test fails.
4. --isolated-script-test-also-run-disabled-tests
  a. This flag is to enable Findit to rerun a test even if it’s           
     disabled, so that Findit can find the culprit of a flaky test even 
     if it has been disabled. 

FYI: general guidance to make Findit support a new test type(https://docs.google.com/document/d/1XZrAecLT33sJng9JTHsWCNpcBVU_BT7weLE76nwsTXA/edit?usp=sharing).
 
Components: Speed>Benchmarks
I can't start owning Telemetry for the next ~4 weeks. If you want something done for this before then, please assign to Ned.
Cc: -nednguyen@chromium.org nedngu...@google.com
Owner: ----
Status: Available (was: Assigned)
I still can't work on this until I am done with fixing stuff for my other team. Marking this available so anyone can work on it. Otherwise I will pick it back up later.

Sign in to add a comment