New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 645518 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Last visit > 30 days ago
Closed: Sep 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Create alert for blocked catapult rolls

Project Member Reported by nedngu...@google.com, Sep 9 2016

Issue description

There have been many cases which catapult roll is blocked for days & people only notice it because they found out their corresponding crbug isn't updated. It would be hugely useful to have alerts sent out when catapult rolls fail.
 

Comment 1 by bore...@google.com, Sep 9 2016

I don't know what, if anything, you use for alerting, but we have an alert for the Skia roll at https://alerts.skia.org/.  We didn't set up the same for other users of our rollers since that page is only used by Skia engineers.
Thanks borenet, can we use that for catapult roll? We just want the system to send email to catapult-sherrifs@c anytime the roll is blocked.
An example today is https://codereview.chromium.org/2326913005/ :-(

Project Member

Comment 4 by sheriffbot@chromium.org, Sep 10 2016

Labels: Hotlist-Google

Comment 5 by bore...@google.com, Sep 12 2016

Are you not receiving emails for the individual rolls?  All of the catapult rolls are  TBR'd to catapult-sheriff@chromium.org, eg. https://codereview.chromium.org/2331933002

If we need to change the spelling to match what you typed in comment 2, we can do that.  We can add an alert to the Skia alerts page, but I'm afraid we'd get complaints from Skia engineers who would see the alert and not be able to do anything about it.
Components: Infra>Client>Perf Infra>Monitoring
We do get the emails for the individual rolls, but the mail subject from rietveld looks the same for success/fail so we need to read every one and track manually. If there was some way to just get a "last N rolls failed" email it would be great. We definitely don't want to add noise for the skia engineers.

Adding Infra>Monitoring in case anyone knows a solution that would work for email alerting here.

Comment 7 by bore...@google.com, Sep 12 2016

Okay, adding alerts: https://skia-review.googlesource.com/c/2387/
Project Member

Comment 8 by bugdroid1@chromium.org, Sep 12 2016

The following revision refers to this bug:
  https://skia.googlesource.com/buildbot.git/+/824ddf32f800d483ad0a9947b441aca43bac59e2

commit 824ddf32f800d483ad0a9947b441aca43bac59e2
Author: Eric Boren <borenet@google.com>
Date: Mon Sep 12 14:45:24 2016

Add alerts for Catapult AutoRoll failures

BUG= chromium:645518 

Change-Id: I38bb1de6b2a83dd4f5abe47a488ee4c3ecf50d23
Reviewed-on: https://skia-review.googlesource.com/2387
Reviewed-by: Joe Gregorio <jcgregorio@google.com>
Commit-Queue: Eric Boren <borenet@google.com>

[modify] https://crrev.com/824ddf32f800d483ad0a9947b441aca43bac59e2/alertserver/alerts.cfg

Comment 9 by bore...@google.com, Sep 12 2016

Owner: borenet@chromium.org
Status: Fixed (was: Untriaged)
Okay, the alerts should show up on https://alerts.skia.org next time the Catapult roll fails.  Let me know if that isn't the case.

Sign in to add a comment