New issue
Advanced search Search tips

Issue 904015 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

Add a slider for setting the failure rate for functional bisects

Project Member Reported by dtu@google.com, Nov 10

Issue description

Pinpoint has a `comparison_mode` API argument that adjusts the sensitivity of the bisection, to trade off between regression size and hardware usage. E.g. to bisect a regression that goes from 0% -> 100% failing requires only 5 repeats, but to bisect a smaller regression that goes from 0% -> 20% failing requires 69 repeats.

Currently, the default for functional bisects is set to 1.0, which can detect solid failures fine, but doesn't work for flaky test failures. We'd like the user to be able to adjust it between 0.1 and 1.0.
 
Status: Assigned (was: Untriaged)
This issue has an owner, a component and a priority, but is still listed as untriaged or unconfirmed. By definition, this bug is triaged. Changing status to "assigned". Please reach out to me if you disagree with how I've done this.

Comment 2 by seanmccullough@chromium.org, Jan 16 (6 days ago)

Owner: st...@chromium.org

Sign in to add a comment