New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 835032 link

Starred by 2 users

Issue metadata

Status: Assigned
Owner:
Last visit > 30 days ago
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

[cr-audit-commits] Add ts_mon based alerts

Project Member Reported by robert...@chromium.org, Apr 19 2018

Issue description

cr-audit-commits needs to alert in the following situations

 - when a ref's scanning has fallen behind
 - when a ref's auditing has fallen behind
 - when a ref's notifications have fallen behind.

Possible approaches to set up these alarms:
 The cron job handler needs to be returning 200's every 5 minutes, raise an alert if it hasn't run in one hour.
 The cron job increments RefAuditsDue metric, raise an alert if 3 or more refs failed to be scheduled in the last hour.
 We should raise an alert if for over an hour, we have scanned more auditable commits than we have actually audited (meaning some commits that need to be audited haven't)
 We should raise an alert if the error ratio > 0 is sustained over an hour.
 
 
Any alerts would need to have an appropriate playbook entry.
Also make sure that these alerts triggering outside business hours will need a different handling.
Status: Assigned (was: Untriaged)
This bug has an owner, thus, it's been triaged. Changing status to "assigned".

Sign in to add a comment