New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 680615 link

Starred by 2 users

Issue metadata

Status: Duplicate
Merged: issue 622359
Owner: ----
Closed: Feb 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: ----



Sign in to add a comment

Add 1-click test disabling

Project Member Reported by zhangtiff@chromium.org, Jan 12 2017

Issue description

Test disabling is a major pain point for sheriffs at the moment. Ideally, we want to make it possible to disable tests with just one click in the UI, but this is a big task, so we will do this in a series of steps. This is what I imagine our approach being: 

1. Scope out the work required by finding all of the different test types sheriffs have to deal with and recording how they currently disable those tests. (Existing documentation for reference: https://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium/handling-a-failing-test )
2. Using our findings from step 1, write up a playbook for test disabling with entries organized by type of test that sheriffs can easily follow in the iterim. 
3. Link tests in sheriff-o-matic to entries in this playbook. 
4. Go through the list of test types and implement automated methods to disable each of the test types in order of impact/effort ratio. 
5. As we implement a 1-click method of disabling each test type, replace the playbook links with "Disable Test" links. 

Along the way, if we notice that different test disabling methods might make more sense to unify closer to the source rather than building automation on top of, it might make sense to discuss this with relevant teams. 
 
Labels: Milestone-Workflow
Plan LGTM.
This looks like a duplicate on issue 622359.
Mergedinto: 622359
Status: Duplicate (was: Untriaged)

Sign in to add a comment