New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 731933 link

Starred by 1 user
Status: Available
Owner: ----
Cc:
█ robert...@chromium.org
chanli@chromium.org
lijeffrey@chromium.org
liaoyuke@chromium.org
st...@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug

Blocking:
issue 698385



Sign in to add a comment

Estimate benefits, resource requirement and CQ overhead of N rerun for new tests

Project Member Reported by st...@chromium.org, Jun 9 2017 
In order to estimate VM resource requirement and overhead to CQ try-jobs, we need to collect following data:
1. How many CLs add new tests per day
2. How many new tests are added per CL
3. How seconds a test take to run (just one iteration)

To estimate benefits, we also need to collect:
4. How many retries were run for those new tests on both Waterfall and CQ
5. Other cost: false CQ rejection, occurrences of flakiness on Waterfall, etc
Project Member

Comment 1 by sheriffbot@chromium.org, Jun 11 2018

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Comment 2 by st...@chromium.org, Jun 14 2018

Labels: -Hotlist-Recharge-Cold prevention
Status: Available (was: Untriaged)
Lower the priority as this is for flake prevention which we still want to pursuit after flake detection and analysis are more solid.

Comment 3 by st...@chromium.org, Aug 2

Blocking: 698385
►

Sign in to add a comment