New issue
Advanced search Search tips

Issue 606618 link

Starred by 2 users
Status: Archived
Owner: ----
Closed: Sep 2016
Cc:
jdonnelly@chromium.org
seanmccullough@chromium.org
zhangtiff@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

"Reliable failures" shows things that have only failed once

Project Member Reported by mgiuca@chromium.org, Apr 26 2016 
Problem with Sheriff-o-Matic:
https://sheriff-o-matic.appspot.com/chromium/

I am seeing two failures right now that have failed exactly one time on the most recent build:
https://sheriff-o-matic.appspot.com/chromium/failure/compile%3A%3AMac
https://sheriff-o-matic.appspot.com/chromium/failure/ipc_mojo_unittests%3A%3AAndroid%20GN

I thought Reliable Failures was supposed to be for things that have failed at least 2x in a row. This makes it hard to tell the difference between flakes / infra issues and legitimate failures.

Comment 1 by seanmccullough@google.com, Apr 26 2016

Status: Available (was: Untriaged)
You are correct about the definition of Reliable Failures, so something is wrong in builder_alerts' interpretation of these logs. Bad news: I probably won't have time to debug this in builder_alerts.

Good news: I'm adding lots of tests for situations like this in alerts-dispatcher (builder_alerts' replacement). In this case, it flags ipc_mojo_unittests correctly as having failed only once: https://screenshot.googleplex.com/gXpS0zgETH6 and compile Mac doesn't even show up because (AFAICT) it's an infra step failure (purple), not an actual build step failure.

Comment 2 by benhenry@google.com, Apr 27 2016

Components: Infra>Monitoring
Labels: -Infra-Monitoring

Comment 3 by aga...@chromium.org, Apr 27 2016

Components: Infra>SheriffOMatic
Labels: -SheriffOMatic

Comment 4 by jdonnelly@chromium.org, Apr 28 2016

Cc: jdonnelly@chromium.org

Comment 5 by benhenry@chromium.org, Jun 29 2016

Components: Infra>Sheriffing>SheriffOMatic

Comment 6 by benhenry@chromium.org, Jun 29 2016

Components: -Infra>Sheriffing

Comment 7 by seanmccullough@chromium.org, Jul 26 2016

Labels: Milestone-SoMLegacy

Comment 8 by zhangtiff@chromium.org, Sep 26 2016

Status: Archived (was: Available)
This issue is being archived because it refers to the old version of Sheriff-o-Matic and is no longer applicable.
►

Sign in to add a comment